Tools for budget help

Part of a normal household is to have a budget for your economy. And as we are thinking on the possibilities for buying a house we need to have a clear view of our economy.

For many is the standard just to use a spreadsheet. Though it is easy to get started with using the spreadsheet, it does not provide a way for syncing between computers and to make more complicated setups with different  accounts and test for different financing possibilities.

 

So my wishlist is a personal financial application / budget software which we can use on my Linux workstation, Macbook laptop and Maries Windows laptop. As we both have iPhone and iPad a tool for viewing the reports on those devices must also be supported. A possibility is a web application running on a local web-server, as I don’t want to use a cloud service and hand over our financial information to third party.

It need to be able to import data from our bank and create grouping and reports based on this data.

 

Tools I have seen on

 

 

Other links

 

 

Remove duplicate of files

I had a number of folders on my MacBook. Each of them a full backup from a mobil phone, from different dates. To clean it up, I decided to only keep the elements in each folder, not present in the next folder.

To do this, I started by creating a diff output

diff -q -s folder1/ folder2 > ~/Desktop/diffOutput.txt

This output contained both the uniq files, but also list the identical files.

So to get a list of the identical file names, I used grep and cut, like the following.

grep identical diffoutput.txt | grep -e "folder1/.* and" -o | cut -f2 -d'/' | cut -f1 -d' ' > ~/Desktop/diffParsed.txt

The last thing is to remove the identical files.

cat ~/Desktop/diffParsed.txt | xargs rm

Preparing video for editing

I had the pleasure to work with some video editing resently. The background is that my sister got some 8mm cine film from our youth converted to a DVD. As this DVD contains clip from many different 8mm cine films mixed together, I would like to split them up and be able to combine them in a new way.

I got the DVD as a dmg image from a mac, so the first thing was to see what kind of dmg image it was.

xxx@stas ~/Delta $ file film-compressed.dmg
film-compressed.dmg: VAX COFF executable - version 8343

This type is a compressed image, so the first thing I need is to decompress it. For this a tool named dmg2img is available in the Gentoo portage tree.

dmg2img -v film-compressed.dmg film-uncompressed.iso

Then I can mount the image and copy the contents out. Now I have the raw data for my videos

sudo mount -o loop -t auto film-uncompressed.iso isoMount

Though was the vob files with error in the form of wrong length. Opening a file in vlc or another tool indicated a length of 9 seconds even though the clip was 3 minutes long. I fixed it together with a conversion using ffmpeg. So a quick script later, my computer was working on the conversion.

#!/bin/bash
 
FILES=./isoContents/VIDEO_TS/*1.VOB
 
for f in $FILES
do
    OUTPUT_FILE=`echo $f | cut -f 4 -d "/" | cut -f 1 -d "."`
    OUTPUT_FILE="./mp4Files/${OUTPUT_FILE}.mp4"
    echo "Outputfile $OUTPUT_FILE"
    ffmpeg -i $f -sameq -vcodec libx264 -acodec libfaac $OUTPUT_FILE
done

Now I have prepared my data, and is ready to do the editing. For this I use kdenlive.

Being the “Timothy McGee” of the family

As a fan of NCIS, I have often seen how Timothy McGee and Abby Sciuto is doing their forensic work on computers, where they need to find some information to solve a case. Of cause they are in a crises, and have some magical graphical interfaces telling them all sort of information extremely fast. In the real world things is a bit different.

I decided to write this post, while recovering some mails for my uncle. He had an old computer, which started spontaneous shutdowns because of a thermal event. So he bought a new computer and asked me for help with getting the old mails. At that point I thought it was an easy job, just involving getting the hard drive, put it in my disk cradle, copy the outlook data file to the new computer and import it. When I dismantled the computer, I noticed the hard drive was a bit older then first expected. It had an IDE interface instead of a SATA interface, so my disk cradle idea did not work. No problem, I will just put it in a computer with IDE interface and access the files from this computer. Though luck, when I booted in Windows 7 check disk failed, and asked if I wanted to format the hard drive. Not the question I had hoped for.

The task just got bigger than first imagined. So the first thing would be to prevent any more damage to the data and file system on the disk. So I put the hard drive in my trusty Gentoo Linux machine and did a raw copy of the partition using dd.

sudo dd if=/dev/sdi1 of=/home/frosteyes/charlie/Bo/diskImage.img

Now having the disk image, I can work on getting the mails without risking to destroy anything on the physical disc. I am using testdisk and photorec. They can be installed by emerge testdisk on Gentoo Linux.

Using testdisk on the image, it shows that the MFT and MFT mirror are bad. Failed to repair them. This was identical with what chkdsk had reported earlier. So no usable master file table (MFT).

The next task was to run photorec on the disc image as seen below. photorec is a recovery program, which among other file types can detect pst files without having a file sytem on the disk. It resulted in a huge number of folders with files, including a number of pst files.

photorecRunning

photorec is running on the disc image

An then finding the pst files I was looking for.

frosteyes@stas ~/charlie/Bo $ find ./ -iname *.pst | xargs ls -l
-rw-r--r-- 1 frosteyes users 81282048  5 maj 17:16 ./recup_dir.133/f9541960.pst
-rw-r--r-- 1 frosteyes users   271360  5 maj 17:19 ./recup_dir.171/f13814104.pst
-rw-r--r-- 1 frosteyes users 24396800  5 maj 18:46 ./recup_dir.374/f47280112.pst
-rw-r--r-- 1 frosteyes users  1033216  5 maj 18:49 ./recup_dir.414/f54353688.pst
-rw-r--r-- 1 frosteyes users   271360  5 maj 18:50 ./recup_dir.416/f55373800.pst

Before handing over the files to my uncle I just tested the files using lspst from libpst. Can be installed with emerge libpst on my Gentoo system. It showed that the pst files contains the needed emails.

So all in all it ended up being more forensic work than expected, but quite fun and I felt a bit like McGee from NCIS.

Removing simple PDF password

At my work I receive my payslip as a pdf file with a password. This is very nice, as it of cause prevents anybody from snooping into my salary. Though today I had the need for sending a copy of my payslip to my bank adviser, so I needed to create a version with the password protection removed. Luckily it was pretty simple, as I could just use ghostscript on my mac. XXX is the password, and the parameters outputFileName.pdf and inputFileName.pdf is self-evident.

gs -q -dSAFER -dNOPAUSE -dBATCH -sDEVICE=pdfwrite \
 -sPDFPassword=XXX -sOutputFile=outputFileName.pdf \
 -c .setpdfwrite -f inputFileName.pdf

Next Page →