Regex to search a whole file and if the line contains the search word, add beginning and ending quotes. I in this case doing it vi(m). This works to add beginning and ending quotes to ALL lines in the file :%s/^(.*)$/”\1″/ or simpler :%s/.*/”&” Explanation: By default, a pattern is…
Formulas for bytes and duration
Capturing a couple formulas for future reference. I was using restic backup stats and wanted to convert the time a job ran into hours and minutes. Also convert bytes process to TB. bytes to TB example: total_bytes_processed: 5773378 / 1000000000000 == 1.502888851889 duration to HH:MM example using libre calc:total_duration: 15870.197288027…
Bash Read Json Config File
Couple of things here. I wanted to do some restic scripts but at the same time use a configuration file. The restic developers is working on this functionality for restic and possibly using TOML. Meanwhile I was trying json since I can definitely use bash/json for other applications. And as…
Bash array json restic snapshots and jq
As you know bash is not ideal with multi arrays. Frequently I find myself wanting to read something like json into bash and loop over it. There are many ways to do this including readarray etc. I found this to work best for me. Note json can have lists so…
restic set tags
In a follow up to previous post https://blog.ls-al.com/restic-create-backup-and-set-tag-with-date-logic here is some code I used to set tags on old snapshots to comply with my new tagging and pruning.
Restic create backup and set tag with date logic
Also see previous post https://blog.ls-al.com/bash-date-usage-for-naming if you are interested. This post is similar but more specific to restic tagging. Below is a test script and a test run. At the time of restic backup I create a tag in order to do snapshot forget based on tags. Below is the…
AWS Cloudwatch Cron
I was trying to schedule a once a week snapshot of a EBS volume and getting “Parameter ScheduleExpression is not valid“. Turns out I missed something small. If you schedule using a cron expression note this important requirement: One of the day-of-month or day-of-week values must be a question mark…
Oracle OCI CLI Query
Some bash snippets of using –query, jq and interacting with Bash to manipulate into variables. Collect boot volume’s id Collect instance ocid Stop instance and collect the id (or whatever you need from the json) Collect the work-request-id to monitor in a loop after I export a custom image to…
Restic snapshot detail json to csv
Restic shows details of a snapshot. Sometimes you want that to be CSV but the json output for paths, excludes and tags are lists which will choke the @csv jq filter. Furthermore not all snapshots have the excludes key. Here are some snippets on solving above. Use join to collapse…