posts

Dukascopy Forex Tick Data

Abstract In my exploration of world of big data and I became curious about tick data. Tick data is extremely granular and provides a great challenge for those looking to work on their optimization skills due to its size. Unfortunately, market data is almost always behind a pay wall or de-sampled to the point of uselessness. After discovering the Dukascopy api, I knew I wanted to make this data available for all in a more accessible format.

Lessons From an Attack on My Homelab

While I was doing some regular maintaince on my minecraft server, I stumbled on a massive log of failed connections via ssh. I closed the port while I did some digging only to find that for the past month, my server was getting blasted 24⁄7 by a botnet. What follows in an analyis of the logs I collected and the lessons I learned about securing a homelab. Attack Post Mortem Thankfully, due to my already security focused outlook, all my homelabs vms where in a secure state.

Deploying Arch Linux VM's in XCP-ng

Arch Linux has a reputation for being obtuse to novice and expert Linux users alike. Furthermore, Arch is rarely supported by VM applications and cloud server providers. After deploying my first XCP-ng hosts, I struggled to find a guide on the viability of installing Arch Linux as a Xen guest. As with many things Arch, it turned out to be much easier than it seemed on the surface. Thanks to the amazing work of the Arch Community, deploying Arch guests was extremely easy and performant.

Parallel Archiving Techniques

The .tar.gz and .zip archive formats are quite ubiquitous and with good reason. For decades they have served as the backbone of our data archiving and transfer needs. With the advent of multi-core and multi-socket CPU architectures, little unfortunately has been done to leverage the wider number of processors. While archiving then compressing a directory may seem like the intuitive sequence, we will show how compressing files before adding them to a .

Preventing Archives From Freezing Ranger

Ranger is one of the few packages I simply can’t live without. Ranger is one of my most used CLI tools and my defacto standard for navigating directories and transferring files. If you love ranger like me though you have come to deal with its many bugs and excentricities. One of the most frustrating for me personally is rangers automatic previewing of archives. While this feature is great if you are dealing with nothing but tiny archives, but not in a directory full of +100GB archives… At that point ranger becomes unusable and a general nightmare.