Ivan Villareal on Ivan Villareal

LAMP in MacOS with macports

Fri, 31 Jan 2020 12:21:51 -0800

Using Macports is easy to setup a MAMP environment with all the custom PHP extensions you may need.

This is what I did to have a dev environment, running on MacOS Catalina:

Install apache and php

❯ sudo port install php74 php74-xdebug php74-apache2handler php74-mysql php74-sqlite php74-mcrypt php74-mbstring php74-openssl

Activate mod_php

❯ cd /opt/local/lib/apache2/modules
❯ sudo /opt/local/bin/apxs -a -e -n php7 mod_php74.so

Activate mod_rewrite

LoadModule rewrite_module lib/apache2/modules/mod_rewrite.so

Set a default php.ini

sudo cp /opt/local/etc/php74/php-development.ini /opt/local/etc/php74/php.ini

Change DirectoryIndex in /opt/local/etc/apache2/httpd.conf from:

DirectoryIndex index.html

To:

DirectoryIndex index.php index.html

Uncomment the vhosts file

Include etc/apache2/extra/httpd-vhosts.conf
Include etc/apache2/extra/mod_php74.conf

Create a new vhost in /opt/local/etc/apache2/extra/httpd-vhosts.conf

<VirtualHost *:80>
ServerName agilistico.test
ServerAdmin webmaster@xilonen.lan
DocumentRoot "/Users/ivan/PhpstormProjects/agilistico.com/public"
<Directory "/Users/ivan/PhpstormProjects/agilistico.com/public">
Options Indexes FollowSymLinks
AllowOverride All
Require all granted
</Directory>
ErrorLog "var/log/apache2/agilistico.test-error_log"
CustomLog "var/log/apache2/agilistico.test-access_log" common
</VirtualHost>

Restart Apache to reflect the config changes

❯ sudo apachectl restart

And finally add the host to /etc/hosts

❯ sudo echo '127.0.0.1 agilistico.test' > /etc/hosts

Now install MySQL (in my case I need 5.7 at the time, but by default network is off so I can install multiple versions)

❯ sudo port install mysql57-server mysql57
❯ sudo /opt/local/lib/mysql57/bin/mysqld --initialize --user=_mysql
❯ sudo chown -R _mysql:_mysql /opt/local/var/db/mysql57/
❯ sudo chown -R _mysql:_mysql /opt/local/var/run/mysql57/
❯ sudo chown -R _mysql:_mysql /opt/local/var/log/mysql57/

Add mysql_client path to the shell, in my case I’ve added the following to ~/.zshrc

 export PATH=$PATH:/opt/local/lib/mysql57/bin

Create another mysql user, default root has no password:

❯ mysql -uroot
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 24
Server version: 5.7.29 Source distribution
Copyright (c) 2000, 2020, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql >

Then in mysql console


CREATE USER 'ivan'@'%' IDENTIFIED BY '123456';
GRANT ALL PRIVILEGES ON *.* TO 'ivan'@'%'WITH GRANT OPTION;
CREATE USER 'ivan'@'localhost' IDENTIFIED BY '123456';
GRANT ALL PRIVILEGES ON *.* TO 'ivan'@'localhost'WITH GRANT OPTION;
flush privileges;

Make apache and mysql start at boot:

❯ sudo port load mysql57-server
❯ sudo port load apache2

Export a list of AWS EC2 Instances as CSV

Wed, 21 Aug 2019 17:00:38 -0700

AWS does not provide a way to export a list of ec2 instances to a csv format, recently there was a need to create such a list to identify what servers were being shared in different projects.

In order to create a excel file with such a list I had to use aws-shell you just need the aws_access_key_id and aws_secret_access_key, we also need jq and sed to process the output which is comming in json.

aws-shell
ec2 describe-instances --region 'us-west-1'
--region 'us-west-2'
--query 'Reservations[].Instances[].[LaunchTime,InstanceId,InstanceType,Placement.AvailabilityZone, Tags[?Key==`Name`].Value|[0], State.Name]'
| jq '.[]' --compact-output
| sed 's/\[\|\]//g'

and this will give me what I need:

"2018-09-28T14:34:40.000Z","i-0134231e3f5512345","m3.large","us-west-2c","BlacoRa-PROD-Worker-HIGH spawned: Fri Sep 28 07:35:36 PDT 2018","running"
"2018-09-28T14:34:40.000Z","i-0cbac4aafabd12345","m3.large","us-west-2c","BlacoRa-PROD-Worker-HIGH spawned: Fri Sep 28 07:35:36 PDT 2018","running"
"2018-09-28T14:34:40.000Z","i-0c32344b965612345","m3.large","us-west-2c","BlacoRa-QA-Worker-BULK spawned: Fri Sep 28 07:35:47 PDT 2018","running"
"2018-09-28T14:34:40.000Z","i-05cbdf22345c7f518","m3.large","us-west-2c","BlacoRa-QA-Worker-BULK spawned: Fri Sep 28 07:35:44 PDT 2018","running"
"2018-09-28T14:34:40.000Z","i-02512345671342567f","m3.large","us-west-2c","BlacoRa-QA-Worker-BULK spawned: Fri Sep 28 07:35:45 PDT 2018","running"
"2018-09-28T14:34:40.000Z","i-0563eabc3445344195","m3.large","us-west-2c","BlacoRa-QA-Worker-BULK spawned: Fri Sep 28 07:35:43 PDT 2018","running"
"2018-11-07T22:29:13.000Z","i-0e7812fed349834288","m3.large","us-west-2c","BlacoRa-QA-Worker-HIGH spawned: Wed Nov 7 14:30:26 PST 2018","running"
"2018-11-07T22:29:13.000Z","i-0abcd72c72bcfd3429","m3.large","us-west-2c","BlacoRa-QA-Worker-BULK spawned: Wed Nov 7 14:30:26 PST 2018","running"

So we have a tag called Name which we need to map it out to the project, if there were more tags that we need to include on the report, is just a matter of adding them to the query Tags[?Key==Project].Value|[0]

Spatie/Permissions Cache Reset Silent Fail

Fri, 10 May 2019 09:58:22 -0700

The Problem

Yesterday I was working on a ACL Implementation and I was using the Spatie/Permissions library all was ok, until I had to run a clean migration to test all my factories.

I was getting the following error:

Spatie\Permission\Exceptions\PermissionAlreadyExists : A `view backend` permission already exists for guard `web`.

I was confused the Permissions table was empty, I was forcing to clear the permission cache file just before starting to add new permissions.

// Reset cached roles and permissions
app()['cache']->forget('spatie.permission.cache');

I even ran my custom composer clear-all command to clear all the cache from views/routes/permission etc.

> @php artisan clear-compiled
Compiled services and packages files removed!
> @php artisan cache:clear
Application cache cleared!
> @php artisan route:clear
Route cache cleared!
> @php artisan view:clear
Compiled views cleared!
> @php artisan config:clear
Configuration cache cleared!
> @php artisan permission:cache-reset
Permission cache flushed.
> composer dumpautoload -o
Generating optimized autoload files> Illuminate\Foundation\ComposerScripts::postAutoloadDump
> @php artisan ide-helper:generate
A new helper file was written to _ide_helper.php
> @php artisan ide-helper:meta
A new meta file was written to .phpstorm.meta.php
> @php artisan package:discover --ansi
Discovered Package: arcanedev/log-viewer
Discovered Package: arcanedev/no-captcha
Discovered Package: barryvdh/laravel-debugbar
Discovered Package: barryvdh/laravel-ide-helper
Discovered Package: beyondcode/laravel-dump-server
Discovered Package: creativeorange/gravatar
Discovered Package: davejamesmiller/laravel-breadcrumbs
Discovered Package: fideloper/proxy
Discovered Package: hieu-le/active
Discovered Package: ivaano/laravel-code-generator
Discovered Package: laravel/tinker
Discovered Package: nesbot/carbon
Discovered Package: nunomaduro/collision
Discovered Package: spatie/laravel-html
Discovered Package: spatie/laravel-permission
Discovered Package: webpatser/laravel-uuid
Package manifest generated successfully.
Generated optimized autoload files containing 4595 classes

But the error kept showing every time i tried to seed, It worked if I changed the permission name or created a new permissions, but it didnt worked with the view backend permission. I spent about an hour looking into this, this happened on my linux laptop I didnt have this issue on OSX, so I left that until Today, so Today I was looking at the permissions library and didnt found anything weird, that was until I’ve decided to see what permissions where being returned, this is the method from the Permissions library

/**
* Get the permissions based on the passed params.
*
* @param array $params
*
* @return \Illuminate\Support\Collection
*/
public function getPermissions(array $params = []): Collection
{
if ($this->permissions === null) {
$this->permissions = $this->cache->remember(self::$cacheKey, self::$cacheExpirationTime, function () {
return $this->getPermissionClass()
->with('roles')
->get();
});
}
$permissions = clone $this->permissions;
foreach ($params as $attr => $value) {
$permissions = $permissions->where($attr, $value);
}
return $permissions;
}

So I found that the cache was returning the view backend permission even though I have cleared the cache, so I dig a little more and found the file that was being called by the cacheManager class, and it was there and it did in fact had the view backedn key, so the command php artisan permission:cache-reset was not clearing the cache also calling it from the code was failing app()['cache']->forget('spatie.permission.cache');. (It was expected as the command is just a wrapper for this call)

In the end the problem was the file ownership, the cache was created by the apache user www-data, on OSX I didnt have this issue because I’m running apache with the same user I’m logged in.

The Solution

A quick solution would be to just remove the file manually, but I will have to find the file and remove it manually everytime I need to clear the cache, so the next approach would be to make apache run as the user I’m logged just like my OSX approach, this would also have other benefits in my dev machine, as I wont have to worry about files created by apache that I cant manage from the cli with my user.

Running apache as a different user is pretty simple in ubuntu just change the user:group in the file /etc/apache2/envvars, restart apache and change all the files to the user that will be running apache.

Lessons learned

Silent Failing is always bad, If I dont see an error where I’m expecting certain behavior I will assume the problem is somewhere else, so it will be a waste of time trying to find the error. This is a Library problem, laravel is returning false when the delete method is called /laravel/framework/src/Illuminate/Filesystem/Filesystem.php, but the library is just assuming that there will be no problems when the cache is cleared.

The fix is simple, just return the result from the cache call and if it fails at least print an error, I’ve sent a PR Show error when cache:reset command fails to fix this, hopefully it gets accepted.

Old Blog revived

Wed, 17 Apr 2019 16:45:29 +0000

I’ve been trying to revive my blog for a while, I was going to use GH pages with Jekyll because Wordpress is such a burden to maintain.

When I started writing my blog I was paying $25 per month to host my blog on a VPS, I had little use for the VPS so most of the time it was just there doing nothing but serving my blog with wordpress, from time to time I had to log into the server update all the packages, and upgrade the wordpress instance. Last time I logged into the server I saw that I haven’t logged in 11 months or so, I was very busy at that time and didnt want to have that server hacked because lack of maintenance, that plus $300 a year in server costs didnt help to make a case on keeping the server.

I knew there was multiple blog platforms but because I want to be in control of my content that discarded every platform, so my only option was a static site, but that didnt happen for another 4 years, I did some previous attempts with Jekyll and Lektor but it was just to much work migrating the content every time I’ve spent an hour or 2 just to be frustrated so I never did the move.

This month I had some spare time, and I’ve decided to do the migration, I was familiar with hugo so I gave it a try, and in less than 2 minutes I had a working site, so I’ve looked in my backups and found my old wp files, along with the db, I thought it would be easy to just get the content from the db dump, but it was not going to work because it had a lot of html embedded and the images were doing references to absolute urls.

So my other option was to try to make the old instance work, I have an Ubuntu 14 VM for legacy projects, so I did quick vhost setup, restored the db put the files, and fixed the config and wordpress worked!

I was planning to use this hugo exporter plugin but the admin dashboard was broken with the following error in the logs:

[Wed Apr 03 20:36:27.151639 2019] [:error] [pid 19662] [client 192.168.8.198:41112] PHP Fatal error: Access to undeclared static property: WP_Screen::$this in /var/www/blogwp.fiv/wp-admin/includes/screen.php on line 706, referer: http://ivanvillareal.com/wp-admin/options-privacy.php

So I edited that part and changed the $this to self and the dashboard worked, I disabled the plugins, and I was able to update the wp instance from the dashboard, I had version 3.4 and it updated to 5.1 without any other issue I have to admit that I was impressed by such feat.

I’ve performed the plugin installation and then exported everything, it did a decent job I had to do some edits to remove the cache stuff, and change the format of the code blocks, but all went ok.

I’ve spent some time on the design and Today I just finished moving all the content. I think all I’ve written is not useful anymore, but reading my old posts brings back memories from a different time, and that has value to me.

Since I stopped writing in this blog I’ve worked with many different technologies, but as today my work is mostly Python on backend services, so I’m going to write about that.

Setup iTerm2 to behave like guake

Wed, 04 Apr 2012 17:50:29 +0000

In my journey of moving from Linux to OSX, I’m always trying to find the tools that I’m used to work, because that’s the way I’m more productive, and one of the most important tools is a good terminal, on linux I used a combination of guake and terminator, the first one to run commands that I need the output immediately the latter to do actual programming stuff, that is because guake can be called from a hotkey and shows a small terminal coming from the top like quake used to do it, this is a fantastic way to run simple commands because the terminal is always open, we just show/hide and only uses a part of the screen, also when it is called is always ready to be used for example if I need to do a quick grep on a project I would do F12 (this is my hotkey) then type grep ‘pattern’ ~/Project/project123 -R then just hide the terminal and continue my work.

When I moved into OS X I searched for a good terminal replacement, one that supported 256 colors with good emulation, and also with the ability to split panes like terminator, and I found iTerm2 a wonderful terminal application that has everything, after setting my profile to work with my vim color scheme, and putting all my stuff from .bashrc I wanted to have a guake like terminal to run commands quickly, and I found the hotkey function so this is how I set it up to work like guake.

First thing is to create a new Profile or duplicate the one that you use the most, then on the Window Tab I set the style as Top of Screen on Main Screen (I have 2 monitors) and on all Spaces. I set 160 columns by 25 Rows.

After I have my profile done, I clicked on the Keys Icon then activated the “Show/hide iTerm2 with a system-wide hotkey” I’m unable to use F12 because that moves me to the dashboard so used ⌘F12 then selected the profile I’ve created and done

here is a small demonstration of how it works after the setup

Create a multiuser git repository with gitolite

Tue, 01 Nov 2011 22:57:54 +0000

I use git for almost all my dev work, is fast, it works locally, and I can even use it as a quick deployment tool, by adding hooks, but when it comes to sharing a repository to other developers, I dont like the idea of creating a user account in the system for each developer, so the easiest and fastest way to solve this issue for me is using gitolite.

In this post I will describe the steps needed to setup a central repository for multiple users. I’m using Centos 5.5 as server and debian as a workstation

Create a user account in the server and install git

[root@bp ~]# useradd -m git
[root@bp ~]# passwd git
[root@bp ~]# yum install git

Copy your public key from our workstation to the server

If you don’t know how to setup an ssh passwordless login, take a look here

ivan@scorpion:~$ scp ~/.ssh/id_rsa.pub git@bp.com:~/ivan.pub

Clone gitolite into the server

ivan@scorpion:~$ ssh git@bp
git@bp: ~$ git clone git://github.com/sitaramc/gitolite
git@bp: ~$ cd gitolite
git@bp: ~$ src/gl-system-install
git@bp: ~$ gl-setup ~/ivan.pub

Go to the workstation to manage the git repo

ivan@scorpion:~$ mkdir -p git/bprepo
ivan@scorpion:~$ cd git/bprepo
ivan@scorpion:~$ git clone git@bp:gitolite-admin

At this point we have 2 folders inside gitolite-admin conf/ and keydir/ the first one is used to create new repositories or add users to repositories the second one is for adding each user public key.

Once you have added new repositories and users you need to do a

git push origin master

on each new repo.

NFS Mac OSX Lion

Mon, 29 Aug 2011 19:37:57 +0000

I was in the need of sharing files from a mac osx 10.7 and some linux servers, so I thought this would be a simple process just like in linux, but I found some issues that prevented me to mount the exported dirs to the mac or to setup a nfsd on the mac OS, this is more a reminder to my self about how I was able to perform that.

Case 1 - Mac OSX as NFS server:

the problem with this one is that the syntax of the exports is different from what I know, but after changing some options I was able to export the Users folder on the mac with the following line:

/Users -alldirs -network 192.168.0.0 -mask 255.255.0.0

to mount the above on my linux box I used this:

ivan@orion:~$ sudo mount -t nfs macbox:Users/ivan/ ivanomac

Only problem found was the weird group and user numbers, so that needs to be mapped out, but because I was only in the need to read some files from the mac I didn’t bother doing that.

Case 2 - Linux NFS server Mac OSX client:

This case is because I have a dev vm, and I need to do constant changes onn it from the mac, the linux flavor of the vm is Ubuntu Server 11.04 and to get the nfs server running I did the following:

scorpion ~# apt-get install nfs-kernel-server nfs-common portmap
scorpion ~# echo “/var/www 192.168.0.0/16(rw,no_subtree_check,no_root_squash)” >> /etc/exports
scorpion ~# exportfs -a

and on the mac I ran the following:

[ivan@kunglao:~$sudo mount -t nfs -o resvport,vers=4 scorpion:/var/www scorpion

with the above I was able to view the files from the ubuntu server, however when I mounted the same export on another ubuntu machine I got the uid/gid wrong, to fix that I just ran the idmapd service on the client machine.

orion ~ # service idmapd start
orion ~# mount -t nfs scorpion:/var/www scorpion

Perl script to manage add/remove Apache virtual hosts

Wed, 08 Jun 2011 19:54:57 +0000

I wrote this script a while back, and I’ve been using it on gentoo, ubuntu and centos distros with a few changes between each distro, this can be extended to add new functionality, and it may contain bugs, but so far it has worked for me pretty well, I can add/remove virtual hosts very quickly.

To use this script you only need the packages File::Path and Getopt::Long; both of them are already on newer distros, just put the script somewhere in your bin path, I have it in /usr/local/bin and call it with sudo.

ivan@orion:/var/www/vhosts$ sudo vhost-updater.pl --add --domain test.orion

This is the output:

Creating docroot dir: /var/www/vhosts/test.orion/public_html
Creating log dir: /var/www/vhosts/test.orion/logs
Site File: /etc/apache2/sites-available/test.orion
Creating Vhost...
Adding host test.orion
Run '/etc/init.d/apache2 reload' to activate new configuration!
Restarting apache
* Restarting web server apache2
... waiting ...done.

Once it has finished, point your browser to http://test.orion, and you’re done.

Enjoy!

#!/usr/bin/perl -w
#############################################################
# The purpose of this script is to add/remove #
# virtual hosts easily, this script runs #
# on Ubuntu/Debian withouth modifications. #
# #
# #
# Author Ivan Villareal ivaano@gmail.com #
# #
#############################################################
use strict;
use File::Path qw(mkpath rmtree);
use Getopt::Long;
our $ipAddress = '127.0.0.1';
our $apacheConfigDir = '/etc/apache2';
our $sitesAvailable = 'sites-available';
our $docRootPrefix = '/var/www/vhosts';
our $docRoot = 'public_html';
our $logsDir = 'logs';
my $del = '';
my $add = '';
my $domain = '';
if (getpwuid( $< ) ne 'root') {
print "Script needs root privileges \n";
exit();
}
unless (GetOptions (
'del' => \$del,
'add' => \$add,
'domain=s' => \$domain) or usage()) {
usage();
}
#print $paramResults;
if ($add || $del) {
if ($domain) {
if ($add) {
createVhost($domain);
} elsif ($del) {
deleteVhost($domain);
}
} else {
usage();
}
} else {
usage();
}
sub usage {
print < <USAGE
This program will add or remove apache virtual hosts.
usage: vhost-updater.pl [--add | --del] --domain newhost.tld
USAGE
}
sub returnVhostPaths
{
my $vhost = shift;
my @dir = split(/\//, $docRootPrefix);
my %res;
push(@dir, $vhost);
my $hostDir = join('/', @dir);
$res{'docRoot'} = $hostDir . '/' . $docRoot;
$res{'logsDir'} = $hostDir . '/' . $logsDir;
$res{'hostDir'} = $hostDir;
#todo dir validation
@dir = split(/\//, $apacheConfigDir);
push(@dir, $sitesAvailable);
push(@dir, $vhost);
$res{'apacheConfig'} = join('/', @dir);
return %res;
}
sub createVhost {
my $vhost = shift;
#first create the docRoot
my %vhostInfo = returnVhostPaths($vhost);
informOut("Creating docroot dir: $vhostInfo{'docRoot'}");
mkpath($vhostInfo{'docRoot'});
my $user = getlogin();
my $uid = getpwnam($user);
my $gid = getgrnam($user);
chown $uid, $gid, $vhostInfo{'hostDir'};
chown $uid, $gid, $vhostInfo{'docRoot'};
informOut("Creating log dir: $vhostInfo{'logsDir'}");
mkpath($vhostInfo{'logsDir'});
informOut("Site File: $vhostInfo{'apacheConfig'}");
my $vhostContent = << "EOF";
<VirtualHost *:80>
ServerName $vhost
DocumentRoot $vhostInfo{'docRoot'}
<directory $vhostInfo{'docRoot'}>
Options Indexes FollowSymLinks
AllowOverride All
Order allow,deny
Allow from all
</directory>
ErrorLog $vhostInfo{'logsDir'}/error_log
CustomLog $vhostInfo{'logsDir'}/access_log "%h %l %u %t \\"%r\\" %>s %b \\"%{Referer}i\\" \\"%{User-agent}i\\""
LogLevel debug
EOF
informOut("Creating Vhost...");
open FILE, ">", $vhostInfo{'apacheConfig'} or die $!;
print FILE $vhostContent;
close FILE;
informOut("Adding host $vhost");
open FILE, ">>", '/etc/hosts' or die $!;
print FILE $ipAddress ."\t". $vhost ."\n";
close FILE;
my $output = `/usr/sbin/a2ensite $vhost`;
print $output;
restartApache();
#print $vhostConten t;
}
sub restartApache
{
informOut("Restarting apache");
my $output = `/etc/init.d/apache2 restart`;
print $output;
}
sub deleteVhost
{
my $vhost = shift;
my %vhostInfo = returnVhostPaths($vhost);
informOut("Removing $vhost from hosts file");
open IN, '< ', '/etc/hosts' or die $!;
my @hostsFile = <IN>;
close IN;
my @contents = grep(!/^127.0.0.1\t$vhost/, @hostsFile);
open FILE, ">", '/etc/hosts' or die $!;
print FILE @contents;
close FILE;
my $output = `/usr/sbin/a2dissite $vhost`;
print $output;
informOut("Removing $vhostInfo{'apacheConfig'} file");
unlink($vhostInfo{'apacheConfig'});
restartApache();
print " manually remove $vhostInfo{'docRoot'}... \n";
}
sub informOut {
my $message = shift;
print "$message \n";
}

Dynamic multi form on same page with jQuery and PHP

Tue, 19 Apr 2011 20:13:50 +0000

This is a little demo of a small app that allow us to have several forms displayed on the same page, organized by sections, a static multiform can be easily created by putting the form contents on divs and hiding them, then when the user clicks on a specific section we hide the previous div, and show the new one, we can wrap it up everything inside a big form, and submit that.

The approach I did for having this same functionality allows me to:

Save each section form before editing a new one
Change any form inputs depending on received data
Validate in the front and backend each section

The main disadvantage is that for each section I’ll do an ajax call, to submit and retrieve the form.

The first thing I did was to write the main html layout I did a simple 2 column layout to use the left block as a form navigator and the right block to show the actual form.

<div class="left_block_box">
<div class="left_block_title">
Form Steps
</div>
<div id="edit_step_box">
<table width="100%" cellspacing="0" cellpadding="0" border="0" style="font-size: 11px;" id="stepTable">
<tr class="stepSelected">
<td class="formStep">
Name
</td>
<td class="stepEdit">
<span id="formstep1" class="pointer placeEdit">Edit</span>
</td>
</tr>
<tr>
<td class="formStep">
Address
</td>
<td class="stepEdit">
<span id="formstep2" class="pointer placeEdit">Edit</span>
</td>
</tr>
<tr>
<td class="formStep">
Interests:
</td>
<td class="stepEdit">
<span id="formstep3" class="pointer placeEdit">Edit</span>
</td>
</tr>
</table>
</div>
</div>

I’ve used a table so I can navigate more easily the DOM with jquery, but this can be changed an ul and it will work the same, the next thing I wrote was the other column wrapper the right block which will holde the actual form retrieved from the server.

<div class="right_block_box">
<div class="right_block_title" id="formTitle">
Form 1
</div>
<div class="multiform_part">
Aqui va la forma
</div>
<div id="form_step_nav_wrap">
<div id="form_step_nav">
<div id="form_step_left">
<input type="button" value="Previous Step" id="prevStepBtn" />
</div>
<div id="form_step_right">
<input type="button" value="Next Step" id="nextStepBtn" />
<input type="button" value="Preview Data" style="display: none" id="previewBtn" />
</div>
</div>
</div>
</div>

Once I had my basic layout I started with the javascript functionality, the first thing was to create a function that allow me to move from one form to another, passing current form values to the calling script and displaying the new form.

function selectStep(step) {
var thisStep = $(step).children().attr('id');
//get current form data to be passed later
 var curr = $(".stepSelected").children(':eq(1)').children().attr('id');
var formData = $("#form_"+curr).serialize();
//add class to selected step
 $("#stepTable tr").removeClass('stepSelected');
$(step).parent().addClass('stepSelected');
//put name of step that is going to be edited
 $("#formTitle").text($(".stepSelected :eq(0)").text());
$(".multiform_part").html("Loading...");
//send data to php, and draw new form
 $.post('processForm.php', {
step: thisStep, saveData: curr, formData: formData
}
,function(data) {
//draw new form
 $(".multiform_part").html(data);
}
);
}

This was easy, then I just binded a click event to each step

// handle the edit link on each step
 $(".stepEdit").each(function(index){
$(this).click(function(e){
selectStep(this);
}
);
});

And now I have a functional multiform pane, that gets its form from php, the backend was also ver simple to make:

<?php
session_start();
$step = $_REQUEST['step'];
$formData = $_REQUEST['formData'];
function save($step, $data) {
$fields = explode('&',$data);
foreach ($fields as $field) {
$keyVal = explode('=', $field);
$key = urldecode($keyVal[0]);
$val = urldecode($keyVal[1]);
$_SESSION[$step][$key] = $val;
}
}
if ($formData) {
$formStep = $_REQUEST['saveData'];
save($formStep, $_REQUEST['formData']);
}
if ($step) {
switch ($step) {
case 'formstep1':
$html = <<<FORM
 <form id="form_{$step}" name="form_{$step}">
 <fieldset>
 <legend>Personal information</legend>
 <div class="fm-req">
 <label for="fm-firstname">First name:</label>
 <input name="fm-firstname" id="fm-firstname" type="text" value="{$_SESSION[$step]['fm-firstname']}"/>
 </div>
 <div class="fm-opt">

 <label for="fm-middlename">Middle name:</label>
 <input id="fm-middlename" name="fm-middlename" type="text" value="{$_SESSION[$step]['fm-middlename']}"/>
 </div>
 <div class="fm-req">
 <label for="fm-lastname">Last name:</label>
 <input name="fm-lastname" id="fm-lastname" type="text" value="{$_SESSION[$step]['fm-lastname']}"/>
 </div>
 </fieldset>
 </fieldset>
 </form>
FORM;
echo $html;
break;
case 'formstep2':
$html = <<<FORM
 <form id="form_{$step}" name="form_{$step}">
<fieldset>
<legend>Address </legend>
 <div class="fm-opt">
 <label for="fm-addr">Address:</label>
 <input id="fm-addr" name="fm-addr" type="text" value="{$_SESSION[$step]['fm-addr']}"/>
 </div>
 <div class="fm-opt">
 <label for="fm-city">City or Town:</label>

 <input id="fm-city" name="fm-city" type="text" value="{$_SESSION[$step]['fm-city']}"/>
 </div>
 <div class="fm-opt">
 <label for="fm-state">State:</label>
 <input id="fm-state" name="fm-state" type="text" value="{$_SESSION[$step]['fm-state']}"/>
 </div>
 <div class="fm-req">
 <label for="fm-zipcode">Zip code:</label>
 <input id="fm-zipcode" name="fm-zipcode" type="text" value="{$_SESSION[$step]['fm-zipcode']}"/>
 </div>
 </fieldset>
</form>

FORM;
echo $html;
break;
case 'formstep3':
$html = <<<FORM
 <form id="form_{$step}" name="form_{$step}">
<fieldset>
<legend>Interests </legend>
 <div class="fm-opt">
 <label for="fm-int1">Interest 1:</label>
 <input id="fm-int1" name="fm-int1" type="text" value="{$_SESSION[$step]['fm-int1']}"/>
 </div>
 <div class="fm-opt">
 <label for="fm-int2">Interest 2:</label>

 <input id="fm-int2" name="fm-int2" type="text" value="{$_SESSION[$step]['fm-int2']}"/>
 </div>
 </fieldset>
</form>

FORM;
echo $html;
break;
case 'getAllData':
echo '<h3>Saved Data</h3>';
echo '<div style="text-align: left;"><pre>';
print_r($_SESSION);
echo '</pre></div>';
break;
}
}

Finally I’ve added some css styles to make it “pretty” and add some other js functionality to navigate back and forth.

You can checkout the working solution ~~here~~, or get the files here this demo saves user data in session, and the session is destroyed each time you load the index page.

Script to copy data from MySQL to postgreSQL

Sat, 02 Apr 2011 12:28:32 +0000

This is a perl script I’ve used to move data from mysql 5.1 to postgres 9, this script doesn’t create a schema, it only grabs the data from mysql and try to put it on the same table in postgres.

The only requirement is DBI for mysql and postgres.

#!/usr/bin/perl
#
# this script moves all the data from mysql to postgres
# modules required are:
#
# http://search.cpan.org/~timb/DBI-1.616/DBI.pm
#
# please change the dsn, srcUser/srcPass and dstUser/Pass variables.
use DBI;
use strict;
my $srcUser = 'ivan';
my $srcPass = '123';
my $srcDbName = 'datatocopy';
my $srcDbHost = 'mini';
my $dstUser = 'ivan';
my $dstPass = '456';
my $dstDbName = 'migrateddata';
my $dstDbHost = '192.168.1.145';
### do not modify ##
my $srcDb = DBI->connect("dbi:mysql:database=$srcDbName;host=$srcDbHost", $srcUser, $srcPass) or die;
my $dstDb = DBI->connect("dbi:Pg:database=$dstDbName;host=$dstDbHost", $dstUser, $dstPass) or die;
####main########
print "Starting to move data from $srcDbHost to $dstDbHost\n";
$srcDb->do("SET NAMES \'UTF8\'");
$dstDb->do("SET CLIENT_ENCODING=\'UTF8\'") or die;
my $srcTables = $srcDb->selectall_arrayref("SHOW TABLES");
my $dstTables = $dstDb->selectall_hashref("SELECT * FROM pg_tables WHERE NOT tablename ~\'^(pg_|sql_)\'","tablename");
my $seqlist = $dstDb->selectall_arrayref("SELECT RELNAME FROM pg_class WHERE relkind=\'S\'");
my $seqmap;
foreach my $s(@$seqlist) {
my $seqname = $s->[0];
if ($seqname=~/^(.*)_([a-z]+)_([a-z]+$)/) {
my $item;
$item->{seq}=$seqname;
$item->{field}=$2;
my $table = $1;
if (exists $dstTables->{$table}) {
push @{$seqmap->{$table}},$item;
} else {
print STDERR "WARN: cannot find table for sequence $seqname\n";
}
}
}
$dstDb->{AutoCommit}=0;
my $totalRowCount = 0;
foreach my $t(@$srcTables) {
my $table = $t->[0];
unless (exists $dstTables->{$table}) {
print STDERR "WARN: table $table does not exists in dest db Pg:$dstDbName\n";
next;
}
print "Clearing data from table $table in $dstDbHost\n";
clear_table($dstDb,$table);
next if $table=~/^cache/;
next if $table=~/^locales/;
print "Copying data from mysql table $table in $srcDbHost to postgres table $table in $dstDbHost\n";
my $cnt = copy_table($srcDb,$dstDb,$table) unless $table=~/^cache/;
$totalRowCount = $totalRowCount + $cnt;
print "$cnt rows copied ($table)\n";
init_seq($dstDb,$table,$seqmap->{$table}); # if (exists $seqmap->{$table});
}
print "Commiting changes \n";
$dstDb->commit;
print "$totalRowCount rows were copied.\n";
exit 0;
sub init_seq {
my ($db,$table,$list)=@_;
return unless $list;
for my $item (@{$list}) {
my $ref = $db->selectall_arrayref("SELECT MAX($item->{field}) FROM $table") or die;
my $val = $ref->[0]->[0];
if ($val) {
$db->do("SELECT SETVAL(\'$item->{seq}\',$val)") or die;
}
}
}
sub clear_table {
my ($dbh,$table)=@_;
return unless $table;
$dbh->do("DELETE FROM $table") or die;
}
sub copy_table {
my ($srcDb,$dstDb,$table)=@_;
die unless $table;
my $slf = $srcDb->prepare("select * from $table limit 1");
my $rows = $slf->execute() or die;
return 0 if $rows < 1;
my $rec1 = $slf->fetchrow_hashref;
$slf->finish;
my @fieldnames = sort keys %$rec1;
my @qm = map { '?'} @fieldnames;
my $ins = $dstDb->prepare("INSERT INTO $table (".join(",",@fieldnames).") VALUES(".join(",",@qm).")");
my $sel = $srcDb->prepare("SELECT * FROM $table");
$sel->execute or die;
my $cnt = 0;
while (my $data = $sel->fetchrow_hashref) {
$ins->execute(map {$data->{$_}} @fieldnames) or die;
$cnt++;
}
$ins->finish;
$sel->finish;
return $cnt;
}

Use hotkeys for switching between dual monitors

Mon, 21 Mar 2011 18:46:57 +0000

I just got 2 Asus ML228 wide-screen monitors, this is a big update from my previous monitors resolution that were 1280x760, and they were not wide-screen, so it took me a while to get used to these wide screen displays, I have them in Full HD via DVI to HDMI connector, and i’m using nVidia twinview instead of Xinerama because I can use compiz with twiview and not with Xinerama, the total display I get from both monitors is 3840x1080 pixels (966x272 millimeters), so I have to move my hand a lot to switch between one monitor and the other with the mouse, I also have my laptop on the left because that is were i have my chat and email apps, so to get there from the right screen I have to move even more my hand until I get to the end of the mousepad.

A friend of mine recommend to use a program to switch between my two monitors with a hotkey, he told me the program he used for windows, I look for it, and I didnt found anything that could work in linux, because I was to busy I left that, until this past week where I just got tired to move from one window to another to check my tests, so I checked again what were my options, and again didnt found nothing that was simple to run.

I knew that I could leverage the commands plugin from compiz to grab the hotkeys, I just needed a way to move the cursor, so I did a quick search in the aptitude repository

ivan@orion:~$ apt-cache search input move

gave me this:

xdotool - simulate X11 keyboard/mouse input

That looked like the thing i was looking for, so i’ve installed xdotool and started playing with it, i quickly found that this little tool has a lot of choices that can be used for many, many things, so what I did to achieve my goal was the following:

ivan@orion:~$ xdotool --help
Available commands:
getactivewindow
getwindowfocus
getwindowpid
search
help
version
click
getmouselocation
key
keydown
keyup
mousedown
mousemove
mousemove_relative
mouseup
type
windowactivate
windowfocus
windowmap
windowmove
windowraise
windowsize
windowunmap
set_window
set_num_desktops
get_num_desktops
set_desktop
get_desktop
set_desktop_for_window
get_desktop_for_window
ivan@orion:~$ xdotool getmouselocation
x:379 y:361 screen:0
ivan@orion:~$ xdotool mousemove 800 200

and with that my pointer moved to a random position 🙂 (800x200) I moved the mouse to the center of left screen and used getmouselocation to get the screen coordinates, I did the same for right screen and with this parameters i’ve opened my compiz configuration and created the following 2 hotkeys:

Decrypting SourceCop php files

Wed, 10 Feb 2010 19:41:46 +0000

Every once in a while, I receive code that is encrypted using one of many php encoder software out there, so when I face this situation and if the project is worth it, I start playing around with the encrypted files to see how the encoding algorithm works, so far I’ve been able to successful decrypt files encoded with Zend, and ioncube, I don’t remember the versions of the encoders but I remember that the latter one took me some time, but I decode the source.

I must say that decoding files also becomes a personal challenge, it is like a hobby when I have the time to play with it.

Yesterday I received a couple of files encoded with an unknown encoder for me, it didnt require any php modification or extension install, so I tough that it would be easy to break it, because at some point the code must be evaluated, so after I opened the zip file, I noticed a folder called “scopbin“, that contained only 1 php file named “911006.php“, the two encoded files were including this file so I assumed that this is were the decryption logic had to be.

I was exhausted by a long working day, and when I got this files and saw that they were encrypted I placed them in my laptop for later analysis. This analysis was done the next day, I didnt research the encoding process, or did anything that give me some pointers, I just started playing around with the code to see how far I could get.

My objective this time was getting this files decrypted, and not analysing the steps of the algorithm, so with this in mind, this is what I did:

This was the original “911006.php” file:

<?php ini_set('include_path',dirname(__FILE__));function A4540acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba,$x276e79316561733d64abdf00f8e8ae48){return $Xew6e79316561733d64abdf00f8e8ae48;}function b5434f0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba,$x276e79316561733d64abdf00f8e8ae48){return $Xew6e79316561733d64abdf00f8e8ae48;}function c43dsd0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba,$x276e79316561733d64abdf00f8e8ae48){return $Xew6e79316561733d64abdf00f8e8ae48;}function Xdsf0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba,$x276e79316561733d64abdf00f8e8ae48){return $Xew6e79316561733d64abdf00f8e8ae48;}function y0666f0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba,$x276e79316561733d64abdf00f8e8ae48){$x0b43c25ccf2340e23492d4d3141479dc='';$x71510c08e23d2083eda280afa650b045=0;$x16754c94f2e48aae0d6f34280507be58=strlen($x897356954c2cd3d41b221e3f24f99bba);$x7a86c157ee9713c34fbd7a1ee40f0c5a=hexdec('&H'.substr($x276e79316561733d64abdf00f8e8ae48,0,2));for($x1b90e1035d4d268e0d8b1377f3dc85a2=2;$x1b90e1035d4d268e0d8b1377f3dc85a2<strlen($x276e79316561733d64abdf00f8e8ae48);$x1b90e1035d4d268e0d8b1377f3dc85a2+=2){$xe594cc261a3b25a9c99ec79da9c91ba5=hexdec(trim(substr($x276e79316561733d64abdf00f8e8ae48, $x1b90e1035d4d268e0d8b1377f3dc85a2, 2)));$x71510c08e23d2083eda280afa650b045=(($x71510c08e23d2083eda280afa650b045<$x16754c94f2e48aae0d6f34280507be58)?$x71510c08e23d2083eda280afa650b045 + 1:1);$xab6389e47b1edcf1a5267d9cfb513ce5=$xe594cc261a3b25a9c99ec79da9c91ba5 ^ ord(substr($x897356954c2cd3d41b221e3f24f99bba, $x71510c08e23d2083eda280afa650b045-1, 1));if($xab6389e47b1edcf1a5267d9cfb513ce5<=$x7a86c157ee9713c34fbd7a1ee40f0c5a)$xab6389e47b1edcf1a5267d9cfb513ce5=255+$xab6389e47b1edcf1a5267d9cfb513ce5-$x7a86c157ee9713c34fbd7a1ee40f0c5a;else $xab6389e47b1edcf1a5267d9cfb513ce5=$xab6389e47b1edcf1a5267d9cfb513ce5-$x7a86c157ee9713c34fbd7a1ee40f0c5a;$x0b43c25ccf2340e23492d4d3141479dc=$x0b43c25ccf2340e23492d4d3141479dc.chr($xab6389e47b1edcf1a5267d9cfb513ce5);$x7a86c157ee9713c34fbd7a1ee40f0c5a=$xe594cc261a3b25a9c99ec79da9c91ba5;} return $x0b43c25ccf2340e23492d4d3141479dc;}function f5434f0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba,$x276e79316561733d64abdf00f8e8ae48){if(file_exists($x456e79316561733d64abdf00f8e8ae48)){unlink($x456e79316561733d64abdf00f8e8ae48);};return $Xew6e79316561733d64abdf00f8e8ae48;}function j43dsd0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba,$x276e79316561733d64abdf00f8e8ae48){if(file_exists($x456e79316561733d64abdf00f8e8ae48)){unlink($x456e79316561733d64abdf00f8e8ae48);};return $Xew6e79316561733d64abdf00f8e8ae48;}function hdsf0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba,$x276e79316561733d64abdf00f8e8ae48){if(file_exists($x456e79316561733d64abdf00f8e8ae48)){unlink($x456e79316561733d64abdf00f8e8ae48);};return $Xew6e79316561733d64abdf00f8e8ae48;}function tr5434f0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba,$x276e79316561733d64abdf00f8e8ae48){if(file_exists($x456e79316561733d64abdf00f8e8ae48)){unlink($x456e79316561733d64abdf00f8e8ae48);};return $Xew6e79316561733d64abdf00f8e8ae48;}function f0666f0acdeed38d4cd9084ade1739498($x) { return implode('',file($x));} function g0666f0acdeed38d4cd9084ade1739498($s){return (strstr($s,'echo')==false?(strstr($s,'print')==false)?(strstr($s,'sprint')==false)?(strstr($s,'sprintf')==false)?false:exit():exit():exit():exit());}function hyr3dsd0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba,$x276e79316561733d64abdf00f8e8ae48){if(file_exists($x456e79316561733d64abdf00f8e8ae48)){unlink($x456e79316561733d64abdf00f8e8ae48);};return $Xew6e79316561733d64abdf00f8e8ae48;}function uygf0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba,$x276e79316561733d64abdf00f8e8ae48){if(file_exists($x456e79316561733d64abdf00f8e8ae48)){unlink($x456e79316561733d64abdf00f8e8ae48);};return $Xew6e79316561733d64abdf00f8e8ae48;}function drfg34f0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba,$x276e79316561733d64abdf00f8e8ae48){if(file_exists($x456e79316561733d64abdf00f8e8ae48)){unlink($x456e79316561733d64abdf00f8e8ae48);};return $Xew6e79316561733d64abdf00f8e8ae48;}function jhkgvdsd0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba,$x276e79316561733d64abdf00f8e8ae48){if(file_exists($x456e79316561733d64abdf00f8e8ae48)){unlink($x456e79316561733d64abdf00f8e8ae48);};return $Xew6e79316561733d64abdf00f8e8ae48;}function yrdhhdacdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba,$x276e79316561733d64abdf00f8e8ae48){if(file_exists($x456e79316561733d64abdf00f8e8ae48)){unlink($x456e79316561733d64abdf00f8e8ae48);};return $Xew6e79316561733d64abdf00f8e8ae48;} ini_set('include_path','.');

I’ve used a code formatter to make the code more readable:

ivan@mini:/var/www/copdecrypt/scopbin$ phpCB --space-after-if \
--space-after-switch \
--space-after-while \
--space-before-srt-angle-bracket \
--space-after-end-angle-bracket \
--glue-amperscore \
--change-shell-comment-to-double-slashes-comment \
--force-large-php-code-tag \
--force-true-false-null-contant-lowercase \
--align-equal-statements \
--comment-rendering-style PEAR \
--equal-align-position 50 \
--padding-char-count 4 \
911006.php

And this was the result:

<?php
ini_set('include_path', dirname(__FILE__));
function A4540acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba, $x276e79316561733d64abdf00f8e8ae48) {
return $Xew6e79316561733d64abdf00f8e8ae48;
}
function b5434f0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba, $x276e79316561733d64abdf00f8e8ae48) {
return $Xew6e79316561733d64abdf00f8e8ae48;
}
function c43dsd0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba, $x276e79316561733d64abdf00f8e8ae48) {
return $Xew6e79316561733d64abdf00f8e8ae48;
}
function Xdsf0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba, $x276e79316561733d64abdf00f8e8ae48) {
return $Xew6e79316561733d64abdf00f8e8ae48;
}
function y0666f0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba, $x276e79316561733d64abdf00f8e8ae48) {
$x0b43c25ccf2340e23492d4d3141479dc = '';
$x71510c08e23d2083eda280afa650b045 = 0;
$x16754c94f2e48aae0d6f34280507be58 = strlen($x897356954c2cd3d41b221e3f24f99bba);
$x7a86c157ee9713c34fbd7a1ee40f0c5a = hexdec('&H' . substr($x276e79316561733d64abdf00f8e8ae48, 0, 2));
for($x1b90e1035d4d268e0d8b1377f3dc85a2 = 2;$x1b90e1035d4d268e0d8b1377f3dc85a2 < strlen($x276e79316561733d64abdf00f8e8ae48);$x1b90e1035d4d268e0d8b1377f3dc85a2 += 2) {
$xe594cc261a3b25a9c99ec79da9c91ba5 = hexdec(trim(substr($x276e79316561733d64abdf00f8e8ae48, $x1b90e1035d4d268e0d8b1377f3dc85a2, 2)));
$x71510c08e23d2083eda280afa650b045 = (($x71510c08e23d2083eda280afa650b045 < $x16754c94f2e48aae0d6f34280507be58)?$x71510c08e23d2083eda280afa650b045 + 1:1);
$xab6389e47b1edcf1a5267d9cfb513ce5 = $xe594cc261a3b25a9c99ec79da9c91ba5 ^ ord(substr($x897356954c2cd3d41b221e3f24f99bba, $x71510c08e23d2083eda280afa650b045-1, 1));
if ($xab6389e47b1edcf1a5267d9cfb513ce5 <= $x7a86c157ee9713c34fbd7a1ee40f0c5a)$xab6389e47b1edcf1a5267d9cfb513ce5 = 255 + $xab6389e47b1edcf1a5267d9cfb513ce5 - $x7a86c157ee9713c34fbd7a1ee40f0c5a;
else $xab6389e47b1edcf1a5267d9cfb513ce5 = $xab6389e47b1edcf1a5267d9cfb513ce5 - $x7a86c157ee9713c34fbd7a1ee40f0c5a;
$x0b43c25ccf2340e23492d4d3141479dc = $x0b43c25ccf2340e23492d4d3141479dc . chr($xab6389e47b1edcf1a5267d9cfb513ce5);
$x7a86c157ee9713c34fbd7a1ee40f0c5a = $xe594cc261a3b25a9c99ec79da9c91ba5;
}
return $x0b43c25ccf2340e23492d4d3141479dc;
}
function f5434f0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba, $x276e79316561733d64abdf00f8e8ae48) {
if (file_exists($x456e79316561733d64abdf00f8e8ae48)) {
unlink($x456e79316561733d64abdf00f8e8ae48);
} ;
return $Xew6e79316561733d64abdf00f8e8ae48;
}
function j43dsd0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba, $x276e79316561733d64abdf00f8e8ae48) {
if (file_exists($x456e79316561733d64abdf00f8e8ae48)) {
unlink($x456e79316561733d64abdf00f8e8ae48);
} ;
return $Xew6e79316561733d64abdf00f8e8ae48;
}
function hdsf0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba, $x276e79316561733d64abdf00f8e8ae48) {
if (file_exists($x456e79316561733d64abdf00f8e8ae48)) {
unlink($x456e79316561733d64abdf00f8e8ae48);
} ;
return $Xew6e79316561733d64abdf00f8e8ae48;
}
function tr5434f0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba, $x276e79316561733d64abdf00f8e8ae48) {
if (file_exists($x456e79316561733d64abdf00f8e8ae48)) {
unlink($x456e79316561733d64abdf00f8e8ae48);
} ;
return $Xew6e79316561733d64abdf00f8e8ae48;
}
function f0666f0acdeed38d4cd9084ade1739498($x) {
return implode('', file($x));
}
function g0666f0acdeed38d4cd9084ade1739498($s) {
return (strstr($s, 'echo') == false?(strstr($s, 'print') == false)?(strstr($s, 'sprint') == false)?(strstr($s, 'sprintf') == false)?false:exit():exit():exit():exit());
}
function hyr3dsd0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba, $x276e79316561733d64abdf00f8e8ae48) {
if (file_exists($x456e79316561733d64abdf00f8e8ae48)) {
unlink($x456e79316561733d64abdf00f8e8ae48);
} ;
return $Xew6e79316561733d64abdf00f8e8ae48;
}
function uygf0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba, $x276e79316561733d64abdf00f8e8ae48) {
if (file_exists($x456e79316561733d64abdf00f8e8ae48)) {
unlink($x456e79316561733d64abdf00f8e8ae48);
} ;
return $Xew6e79316561733d64abdf00f8e8ae48;
}
function drfg34f0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba, $x276e79316561733d64abdf00f8e8ae48) {
if (file_exists($x456e79316561733d64abdf00f8e8ae48)) {
unlink($x456e79316561733d64abdf00f8e8ae48);
} ;
return $Xew6e79316561733d64abdf00f8e8ae48;
}
function jhkgvdsd0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba, $x276e79316561733d64abdf00f8e8ae48) {
if (file_exists($x456e79316561733d64abdf00f8e8ae48)) {
unlink($x456e79316561733d64abdf00f8e8ae48);
} ;
return $Xew6e79316561733d64abdf00f8e8ae48;
}
function yrdhhdacdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba, $x276e79316561733d64abdf00f8e8ae48) {
if (file_exists($x456e79316561733d64abdf00f8e8ae48)) {
unlink($x456e79316561733d64abdf00f8e8ae48);
} ;
return $Xew6e79316561733d64abdf00f8e8ae48;
}
ini_set('include_path', '.');

After a quick review of this file, I saw that it had several functions with the same logic, return an unknow variable or delete the file that this unknown variable had, appart from all this “useless” functions I quickly found what appeared to be the decryption function this was the function named y0666f0acdeed38d4cd9084ade1739498 with this information I ran a quick check by passing the content of one of the encrypted files, and this is the response I got from that function:

<?php if(!function_exists('findsysfolder')){function findsysfolder($fld){$fld1=dirname($fld);$fld=$fld1.'/scopbin';clearstatcache();if(!is_dir($fld))return findsysfolder($fld1);else return $fld;}}require_once(findsysfolder(__FILE__).'/911006.php');$REXISTHECAT4FBI='FE50E574D754E76AC679F242F450F768FB5DCB77F34DE341 660C280D176E374DE7FB3B090A782B6B68DBC97BEAD93B681C452F25BE26';g0666f0acdeed38d4cd9084ade1739498(f0666f0acdeed38d4cd9084ade1739498(__FILE__));$REXISTHEDOG4FBI='9CEF6BE117B329ADFC4560538EBF16BB6DAD1748FE354E8EDA7AABFA376EB6938496F43560E4123D85D272E342E363FD51F3181763A3F623 660B6E2369243EE5781CD76A133E272E37DACA198968397F150425B4326A126CD64F051F35287DE7BD3 5354276B880BDEF525247533610 64282D07BA63861F81DB715C115BC1BD57FC5D9C8 225D2 A F177EDC7EA026A7E74D37AC28A125D1B8F73B63C6D1C3A1E137639BEECEDACFDBBD9F8D948CE93D6FCDCDD8CCA98B36AA21A08B8BD87FD8 15143C2C2D37593B82857516FC9ABF9237BDEC9DBB9F92F7BDEB8EE3B6AEA153C9DF3 A2CAE2CD218B1E566C0D274D6 F32DC2A E20 512 062A2F72C 96FB9ED3B6FC9ABF927A34985CAB5D3 65D89B315B3E61076D8 E4488B2127FCEF82C78DDBBED3A6FBB7FCEEACEE04453412363B6E246F05086C7 52E C408CC263E078A53461E0 331B71EB81DC475DB6CAC9531914393D4 22AC9C3D7CE7194438AD638 03D6FCDCDD8CCA98F99211B1177D5C7DEC6A3F427 5 510 461C7D1C51AB492F850FA56FE445EC0154885BDACDC 819BD76A72A419A4D859CFE5A5268CDABFD2A7FAB8DEF227BA3869183E12277A386E03763B6E241F75282CDBFCA187ECE74D7 D1D4881D3C7432177D4 E3F83DA54417EAA8FE93C68BDE94C2E7CA5FD5B4C5E3C9993A98CEA3D69BCE84F2D989C9EEECFDDBFFF15 164C2D471D3 228D3 51CBA75D4 A3C85C1 4618EC5 E6BE91FCD F4D87BE F 56BFB5BFE2A3EA923BDDDBB9D26BE13CD 41F6E584D593C1A C18 D19D29D958C94F12577D5D5C0D4B19781958094F21EB6EF20CC77D87CD0CDC57FA13D8484F61076D47ED5 366F521A6FA2FEFBAF22772A680E23168B0958290F23366B297F12470A5F1543664EF6DA42DAD5E5EB718C569EA2C5F8AE81BBF16BE489E3EE13D7FBD98FE297DA8FC5B396BB2EA4E594B2969D3C7689230A1F4441763B1E83114 31173B3E6331670A6F22672D4B6E43C64C1D6C475FA5AFB2BDF36A83F9F55F8 62A C69BEEC4F4F5A4E2B D1B F1A E68CAD86F44 B1C E6CACF92E B6DDCDDD26437 3';$REXISTHECAT4FBI='94CD76CD371C5A7BC70C186E779C293B9B49BACA5A781A6'; eval(y0666f0acdeed38d4cd9084ade1739498('4EF6454FB298E72B 5',$REXISTHEDOG4FBI));?>

Again I used the code beautifier to make the file more readable:

<?php if (!function_exists('findsysfolder')) {
function findsysfolder($fld) {
$fld1 = dirname($fld);
$fld = $fld1 . '/scopbin';
clearstatcache();
if (!is_dir($fld))return findsysfolder($fld1);
else return $fld;
}
}
require_once(findsysfolder(__FILE__) . '/911006.php');
$REXISTHECAT4FBI = 'FE50E574D754E76AC679F242F450F768FB5DCB77F34DE341 660C280D176E374DE7FB3B090A782B6B68DBC97BEAD93B681C452F25BE26';
g0666f0acdeed38d4cd9084ade1739498(f0666f0acdeed38d4cd9084ade1739498(__FILE__));
$REXISTHEDOG4FBI = '9CEF6BE117B329ADFC4560538EBF16BB6DAD1748FE354E8EDA7AABFA376EB6938496F43560E4123D85D272E342E363FD51F3181763A3F623 660B6E2369243EE5781CD76A133E272E37DACA198968397F150425B4326A126CD64F051F35287DE7BD3 5354276B880BDEF525247533610 64282D07BA63861F81DB715C115BC1BD57FC5D9C8 225D2 A F177EDC7EA026A7E74D37AC28A125D1B8F73B63C6D1C3A1E137639BEECEDACFDBBD9F8D948CE93D6FCDCDD8CCA98B36AA21A08B8BD87FD8 15143C2C2D37593B82857516FC9ABF9237BDEC9DBB9F92F7BDEB8EE3B6AEA153C9DF3 A2CAE2CD218B1E566C0D274D6 F32DC2A E20 512 062A2F72C 96FB9ED3B6FC9ABF927A34985CAB5D3 65D89B315B3E61076D8 E4488B2127FCEF82C78DDBBED3A6FBB7FCEEACEE04453412363B6E246F05086C7 52E C408CC263E078A53461E0 331B71EB81DC475DB6CAC9531914393D4 22AC9C3D7CE7194438AD638 03D6FCDCDD8CCA98F99211B1177D5C7DEC6A3F427 5 510 461C7D1C51AB492F850FA56FE445EC0154885BDACDC 819BD76A72A419A4D859CFE5A5268CDABFD2A7FAB8DEF227BA3869183E12277A386E03763B6E241F75282CDBFCA187ECE74D7 D1D4881D3C7432177D4 E3F83DA54417EAA8FE93C68BDE94C2E7CA5FD5B4C5E3C9993A98CEA3D69BCE84F2D989C9EEECFDDBFFF15 164C2D471D3 228D3 51CBA75D4 A3C85C1 4618EC5 E6BE91FCD F4D87BE F 56BFB5BFE2A3EA923BDDDBB9D26BE13CD 41F6E584D593C1A C18 D19D29D958C94F12577D5D5C0D4B19781958094F21EB6EF20CC77D87CD0CDC57FA13D8484F61076D47ED5 366F521A6FA2FEFBAF22772A680E23168B0958290F23366B297F12470A5F1543664EF6DA42DAD5E5EB718C569EA2C5F8AE81BBF16BE489E3EE13D7FBD98FE297DA8FC5B396BB2EA4E594B2969D3C7689230A1F4441763B1E83114 31173B3E6331670A6F22672D4B6E43C64C1D6C475FA5AFB2BDF36A83F9F55F8 62A C69BEEC4F4F5A4E2B D1B F1A E68CAD86F44 B1C E6CACF92E B6DDCDDD26437 3';
$REXISTHECAT4FBI = '94CD76CD371C5A7BC70C186E779C293B9B49BACA5A781A6';
eval(y0666f0acdeed38d4cd9084ade1739498('4EF6454FB298E72B 5', $REXISTHEDOG4FBI));

So what we have here is more obfuscated code, but a simple to understand, we have 2 variables and 3 functions, the variable that has the encrypted code should be the larger one so In the above file I’m assuming that is the ”$REXISTHEDOG4FBI” variable, the other one apparently isn’t used, so what I did at this point was to print the results of the evaluated function which corresponds to the function where the decrypt logic is (below is the decryption function deobfuscated):

function ($key, $program) {
$result = '';
$position = 0;
$keyLength = strlen($key);
$decValue = hexdec('&H' . substr($program, 0, 2));
for($i = 2;$i &lt; strlen($program);$i += 2) {
$decProgram = hexdec(trim(substr($program, $i, 2)));
$position = (($position &lt; $keyLength) ? $position + 1 : 1);
$ascii = $decProgram^ ord(substr($key, $position-1, 1));
if ($ascii &lt;= $decValue) $ascii = 255 + $ascii - $decValue;
else $ascii = $ascii - $decValue;
$result = $result . chr($ascii);
$decValue = $decProgram;
}
return $result;
}

unfortunately printing the result didn’t work, so I did a review to check why, and I found that the other 2 functions where the problem, let me explain what happens, first a call is made to:

function f0666f0acdeed38d4cd9084ade1739498($x) {
return implode('', file($x));
}

this function receives the name of the executing file (test.php in my case), read its content in an array, then glues all lines to create a 1 line string, without any new lines, then this result is passed to the following function:

function g0666f0acdeed38d4cd9084ade1739498($s) {
return (strstr($s, 'echo') == false ? (strstr($s, 'print') == false) ? (strstr($s, 'sprint') == false) ? (strstr($s, 'sprintf') == false) ? false : exit() : exit() : exit() : exit());
}

which are a series of nested ternary conditions, looking for the words “echo,print,sprint,sprintf”, if any of this words are in the encrypted file, then the script simply exits, that’s why I was unable to print the decrypted code after calling the decoding function, so simply avoiding the call to this function will fix the issue and I will get the decrypted code.

However, I didnt want to modify the original encrypted files, so a second approach I took was to modify the decryption function and printing the output from there, so I’ve added a couple of lines (15 and 16) to the “y0666f0acdeed38d4cd9084ade1739498” function:

function y0666f0acdeed38d4cd9084ade1739498($x897356954c2cd3d41b221e3f24f99bba, $x276e79316561733d64abdf00f8e8ae48) {
$x0b43c25ccf2340e23492d4d3141479dc = '';
$x71510c08e23d2083eda280afa650b045 = 0;
$x16754c94f2e48aae0d6f34280507be58 = strlen($x897356954c2cd3d41b221e3f24f99bba);
$x7a86c157ee9713c34fbd7a1ee40f0c5a = hexdec('&H' . substr($x276e79316561733d64abdf00f8e8ae48, 0, 2));
for($x1b90e1035d4d268e0d8b1377f3dc85a2 = 2;$x1b90e1035d4d268e0d8b1377f3dc85a2 &lt; strlen($x276e79316561733d64abdf00f8e8ae48);$x1b90e1035d4d268e0d8b1377f3dc85a2 += 2) {
$xe594cc261a3b25a9c99ec79da9c91ba5 = hexdec(trim(substr($x276e79316561733d64abdf00f8e8ae48, $x1b90e1035d4d268e0d8b1377f3dc85a2, 2)));
$x71510c08e23d2083eda280afa650b045 = (($x71510c08e23d2083eda280afa650b045 &lt; $x16754c94f2e48aae0d6f34280507be58)?$x71510c08e23d2083eda280afa650b045 + 1:1);
$xab6389e47b1edcf1a5267d9cfb513ce5 = $xe594cc261a3b25a9c99ec79da9c91ba5 ^ ord(substr($x897356954c2cd3d41b221e3f24f99bba, $x71510c08e23d2083eda280afa650b045-1, 1));
if ($xab6389e47b1edcf1a5267d9cfb513ce5 &lt;= $x7a86c157ee9713c34fbd7a1ee40f0c5a)$xab6389e47b1edcf1a5267d9cfb513ce5 = 255 + $xab6389e47b1edcf1a5267d9cfb513ce5 - $x7a86c157ee9713c34fbd7a1ee40f0c5a;
else $xab6389e47b1edcf1a5267d9cfb513ce5 = $xab6389e47b1edcf1a5267d9cfb513ce5 - $x7a86c157ee9713c34fbd7a1ee40f0c5a;
$x0b43c25ccf2340e23492d4d3141479dc = $x0b43c25ccf2340e23492d4d3141479dc . chr($xab6389e47b1edcf1a5267d9cfb513ce5);
$x7a86c157ee9713c34fbd7a1ee40f0c5a = $xe594cc261a3b25a9c99ec79da9c91ba5;
}
echo $x0b43c25ccf2340e23492d4d3141479dc;
die();
return $x0b43c25ccf2340e23492d4d3141479dc;
}

And voilà, I was able to see the source code.

TL:DR, just print the output of the decrypt function, and kill the script to get the decrypted code, I don’t know if there are any other versions of the “911006.php” file, but I guess that the same logic applies.

At least The IonCube and Zend Loaders does this with an engine extension, so there is no way you can view the source withouth modifyng the php engine, but this “encryptors” that offer “security by obscurity” is never a good idea, also most of the time the source encrypted is most likely a pile of garbage.

Ubuntu 9.10 on an hp mini 110-1125nr

Wed, 27 Jan 2010 00:56:14 +0000

I got this new mini 110, it came with Windows 7 Starter, and after a day of using it I was very frustrated because it was very limited, for example, I was unable to change my Desktop background, the network management is confusing and frustrating, and it had a lot of crapware, except for the hp games which some of them are fun.

Anyway, right now I don’t have time to spend getting a new OS on this machine, I just want something that works, I don’t plan using this to work, but I would like to have some of the tools I use into this.

So my options were, trying Ubuntu remix or Windows Xp, after checking that hp had the drivers for XP, I was going to change Windows 7 to Xp, but I was reading how to create a USB boot drive, and it was too much hassle for me. (I’m very lazy for any Microsoft stuff).

My next option was Ubuntu remix, I’m not a big fan of Ubuntu, but I wanted something that just worked out of the box, also this little netbook comes with splashtop, a really nice firmware browser for checking stuff online fast, and I didn’t want to loose that so I really didn’t knew how well this was going to work.

I started downloading Ubuntu 9.10 Karmic yesterday night, just in case, Today after I’ve found more frustrating things, I decided to give Karmic a try.

I grabbed my usb pendrive, a 1gb kingston traveler, mounted the ISO and ran usbinst.exe, it was pretty straightforward, my only advice would be to avoid saving space for your documents in the usb, my first try I set this to 30Mb and the boot failed, so I set the do not save feature.

It took about 40 minutes to finish copying the files, after it was done, I restarted the netbook with the pendrive connected, and at the first boot screen I pressed F9 key for booting options, selected the pendrive and that was it.

After testing ubuntu from the pendrive, it ran pretty well and everything but the wifi worked, I did an installation, keeping the windows partition and the hp restore partition, just in case.

The installation was pretty smooth, no issues at all, after the first boot I just installed the broadcom drivers, it was easy with the driver manager in ubuntu, and the wifi was working

Update 03/05/2010: My hp mini was stolen by a couple of elderly people at Walmart, I saw the security video :(, so I’m unable to play more with this, but the time I had this laptop I was very happy with it, it performed well on linux.

File Type Detection in PHP

Fri, 25 Dec 2009 04:47:24 +0000

I’m working on a project where the users can upload files, and I need to know the type of file they are uploading, a simple solution would be to check the extensions of the files, but this has many flaws, so I was looking for a reliable way to detect the type of file, and I found a PECL extension called file info this extension is enabled by default in PHP 5.3, unfortunately I’m running PHP 5.2.10, and the prod server also has this version.

So what I did to install this on ubuntu 9.10 karmic was the following:

root@mini:/etc/php5/apache2# apt-get install php5-dev libmagic-dev php-pear
....
root@mini:/etc/php5/apache2# pear channel-update pear.php.net
...
root@mini:/etc/php5/apache2# pecl install Fileinfo
....
Build process completed successfully
Installing '/usr/lib/php5/20060613+lfs/fileinfo.so'
install ok: channel://pear.php.net/Fileinfo-1.0.4

and finally I added the extension to php.ini

extension=fileinfo.so

I restarted the apache server, and tested with this

$fileInfo = new finfo(FILEINFO_MIME);
$mimeType = $fileInfo->buffer(file_get_contents($uploadedFile));

Format a Mysql DateTime Field with Zend_Date

Thu, 10 Dec 2009 19:54:41 +0000

Zend_Date is really a time saver class, I use it in almost every project I work, It handles time_zones, and date formatting pretty easy, leaving me more time to focus on other things.

The files that I need to use Zend_Date as a standalone class are:

Date.php and the Date folder from the Zend distribution package, and this is how I use it:

<?php
set_include_path('./lib' . PATH_SEPARATOR . get_include_path());
include_once 'Zend/Date.php';
$tugId = isset($_GET['tugId']) ? (int) $_GET['tugId'] : false;
function formatDate($date) {
/**
 * List of supported timezones
 * http://php.net/manual/en/timezones.php
 */
if ($date) {
$fmtDate = new Zend_Date($date, Zend_Date::ISO_8601);
$fmtDate->setTimezone('America/Los_Angeles');
return $fmtDate->toString(Zend_Date::DATETIME);
} else {
return '';
}
}
if (is_int($tugId)) {
$sql = 'SELECT modified_date FROM tuggler WHERE tug_id = ' . $tugId;
$result = $db->fetchAssoc($sql);
$response = 'Last Record Update: '.formatDate($row['modified_date']) .'';
} else {
$response "nothing to return";
}
echo $response;

The response from the above would be Jul 9, 2009 11:41:20 AM but I can easily change it using one of the predefined constants, or I can make my own format.