some tools used on/in idiot.io blog
sitemap
generate a sitemap
git clone git@github.com:c4software/python-sitemap.git cd python-sitemap.git python main.py --domain https://idiot.io --output sitemap.txt
you can then push the sitemap.txt to the webserver using
rsync -av --rsync-path="sudo rsync" dev/python-sitemap/sitemap.txt idiot:/var/www/html
note the trick here with passing sudo rsync to the remote, it will bypass permission issues on the remote. (need to fix that good, a better option is to run this as a cron job on the server every few days