https://github.com/JustinTimperio/gdelt-diff
This small tool is designed to automate the download, orginization, and storage of GDELT source files. GDELT-Diff includes a deamon that runs every 60 mins fetching any new or missing files and sorts them into folders for easy storage. Additionally, an extremely lightweight tool is provided to maintain a copy of only the streams most recent files in /tmp/gdelt-live. This is for anyone doing real-time analysis of the GDELT and doesn’t require a full copy of the source files.