psw/borgmatic
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1929 commits 2 branches 0 tags 3.6 MiB
Commit graph

764 commits

Author SHA1 Message Date
Chirag Aggarwal
68ee9687f5 Added tests for all subcommands and used black formatter 
Signed-off-by: Chirag Aggarwal <thechiragaggarwal@gmail.com>
 2023-04-27 22:27:23 +05:30
Chirag Aggarwal
96aca4f446 Updated existing tests to use new parameters 
Signed-off-by: Chirag Aggarwal <thechiragaggarwal@gmail.com>
 2023-04-24 20:24:41 +05:30
Dan Helfman
5962fd473e Another try. Backing out psql error changes (#678). 2023-04-21 10:34:50 -07:00
Jesse Johnson
a14870ce48 Expand source directories when checking for existence (#682). 2023-04-21 05:52:04 +00:00
Dan Helfman
da0f5a34f2 Fix multiple bugs in PostgreSQL hook (#678). 
Reviewed-on: https://projects.torsion.org/borgmatic-collective/borgmatic/pulls/677
 2023-04-21 04:05:22 +00:00
Dan Helfman
065be1d9d4 More inclusive language. 2023-04-20 14:28:04 -07:00
Dan Helfman
9f5769f87b Make docs/schema a little more container agnostic / less Docker specific. 2023-04-16 15:41:17 -07:00
Chirag Aggarwal
1ee56805f1 Merge remote-tracking branch 'upstream/master' into borg2-archive-flags 2023-04-15 17:29:20 +05:30
Dan Helfman
8cb5a42a9e Drop deprecated pkg_resources in favor of importlib.metadata and packaging. 2023-04-14 21:21:25 -07:00
Dan Helfman
5dbb71709c Upgrade test requirements and code style requirements. Auto-reformat code accordingly. 2023-04-14 19:35:24 -07:00
Dan Helfman
81e167959b
feat: restore specific schemas (#375). 
Merge pull request #67 from diivi/feat/restore-specific-schemas
 2023-04-14 16:26:25 -07:00
Divyansh Singh
f273e82d74 add tests 2023-04-15 02:57:51 +05:30
Jakub Jirutka
17f122bfe5 Use psql instead of pg_restore when format is "plain" 
pg_restore: error: input file appears to be a text format dump. Please use psql.
 2023-04-14 17:38:19 +02:00
Jakub Jirutka
f0f43174c6 Swap if-else in restore_database_dump in postgresql hook for cleanliness 2023-04-14 17:38:19 +02:00
Jakub Jirutka
dfccc1b94a Exit on error when restoring all PostgreSQL databases 
"--set ON_ERROR_STOP=on" is equivalent to "--exit-on-error" in
pg_restore.
 2023-04-14 17:38:18 +02:00
Jakub Jirutka
195024e505 Fix psql_command and pg_restore_command to accept command with arguments 
These commands are executed without `shell=True`, so the subprocess
module treats e.g. "docker exec my_pg_container psql" as a single command
(resulting in Errno 2 "No such file or directory") instead of a command
with arguments.
 2023-04-14 17:37:38 +02:00
Jakub Jirutka
19a00371f5 Run "psql" with "--no-psqlrc" 
Some settings in user's .psqlrc, e.g. "linestyle unicode", may break the
CSV output. "--no-psqlrc" tells psql to not read startup file.

This is not necessary for the analyze_command and restore_command (with
all_databases), but it's generally recommended when running psql from a
script.
 2023-04-14 17:37:37 +02:00
Jakub Jirutka
874fba7672 Fix PostgreSQL hook not using "psql_command" for list when dumping "all" 2023-04-14 15:13:49 +02:00
Dan Helfman
4a94c2c9bf Selectively omit list values when including configuration files (#672). 2023-04-13 14:39:36 -07:00
Dan Helfman
1ea4433aa9 Selectively shallow merge certain mappings or sequences when including configuration files (#672). 2023-04-11 21:49:10 -07:00
Divyansh Singh
2fea429d78 collection restore for mongodb 2023-04-12 09:34:19 +05:30
Divyansh Singh
264cebd2b1 complete psql multi schema backup 2023-04-11 23:19:49 +05:30
Dan Helfman
4c0e2cab78 View the results of configuration file merging via "validate-borgmatic-config --show" flag (#673). 2023-04-11 10:49:09 -07:00
Dan Helfman
b4b1fa939d
feat: add logfile name to hook context for interpolation 
Merge pull request #68 from diivi/feat/add-log-filename-to-hook-context
 2023-04-06 13:46:45 -07:00
Divyansh Singh
16d7131fb7 refactor tests 2023-04-07 01:00:38 +05:30
Divyansh Singh
091d60c226 refactor and improve tests 2023-04-06 12:36:10 +05:30
Divyansh Singh
0fbdf8d860 feat: add logfile name to hook context for interpolation 2023-04-06 09:31:24 +05:30
Dan Helfman
192bfe46a9 Fix error when running the "prune" action with both "archive_name_format" and "prefix" options set (#668). 2023-04-05 14:58:05 -07:00
Divyansh Singh
9bc2322f9a feat: restore specific schemas 2023-04-06 02:10:36 +05:30
Dan Helfman
616eb6b6da Fix error with "info --match-archives" and fix "--match-archives" overriding logic (#666). 2023-04-04 21:25:10 -07:00
Dan Helfman
7e6bee84b0 Add "--log-file-format" flag for customizing the log message format (#658). 2023-04-02 23:06:36 -07:00
Dan Helfman
9712d00680 Add "match_archives" option (#588). 2023-04-01 23:57:55 -07:00
Dan Helfman
2934d0902c Code spell checking on every test run! 2023-04-01 11:03:59 -07:00
Divyansh Singh
32ab17fa46 merge 2023-04-01 22:12:41 +05:30
Divyansh Singh
6054ced931 fix: run typos 2023-04-01 22:10:32 +05:30
Dan Helfman
3f78ac4085 Automatically use the "archive_name_format" option to filter which archives get used for borgmatic actions that operate on multiple archives (#479). 2023-03-31 15:21:08 -07:00
Dan Helfman
5f595f7ac3 Fix regression in which the "transfer" action produced a traceback (#663). 2023-03-30 23:21:20 -07:00
Dan Helfman
b27e625a77 Update schema comment for check_repositories to mention labels (#635). 2023-03-28 15:44:38 -07:00
Divyansh Singh
ce22d2d302 reformat 2023-03-28 22:29:21 +05:30
Divyansh Singh
2d08a63e60 fix: make check repositories work with dict and str repositories 2023-03-28 22:14:50 +05:30
Chirag Aggarwal
98c6aa6443 Use Square brackets to denote version specific flag 
Signed-off-by: Chirag Aggarwal <thechiragaggarwal@gmail.com>
 2023-03-28 18:15:49 +05:30
Chirag Aggarwal
edd79ed86c removed individual action parameters, and used make_flags_from_arguments 
Signed-off-by: Chirag Aggarwal <thechiragaggarwal@gmail.com>
 2023-03-28 18:10:42 +05:30
Dan Helfman
7a8e0e89dd Mention prior versions of borgmatic in repositories schema. 2023-03-27 21:54:01 -07:00
Dan Helfman
0e3da7be63 Fix repository schema description. 2023-03-27 16:15:24 -07:00
Dan Helfman
3e8e38011b
Labels for repositories (#635). 
Merge pull request #57 from diivi/feat/tag-repos
 2023-03-27 15:46:22 -07:00
Chirag Aggarwal
4fa4fccab7 Use make_flags_from_arguments on mount; Pending test fixes 
Signed-off-by: Chirag Aggarwal <thechiragaggarwal@gmail.com>
 2023-03-27 23:24:17 +05:30
Dan Helfman
d0d3a39833 When a database command errors, display and log the error message instead of swallowing it (#396). 2023-03-27 10:36:39 -07:00
Dan Helfman
acbbd6670a Removing debugging command output. 2023-03-26 21:26:35 -07:00
Divyansh Singh
ec9def4e71 rename repository arg to repository_path in all borg actions 2023-03-26 23:52:25 +05:30
Divyansh Singh
b511e679ae remove optional label for repos from tests 2023-03-26 16:59:29 +05:30
jetchirag
ff1f4dc09c minor fixes to prune argument help text 2023-03-26 02:06:46 +05:30
jetchirag
141474ff07 Added TIMESPAN flags to match archive in various commands (Borg2 feature) 
Signed-off-by: jetchirag <thechiragaggarwal@gmail.com>
 2023-03-26 01:58:03 +05:30
Dan Helfman
19e95628c3 Add documentation and NEWS for custom constants feature (#612). 2023-03-24 23:47:05 -07:00
Dan Helfman
4d01e53414
Fix: replace primitive values in config without quotes (#612). 
Merge pull request #62 from diivi/fix/config-json-replacement
 2023-03-24 23:45:36 -07:00
Divyansh Singh
a082cb87cb fix: replace primitive values in config without quotes 2023-03-25 12:12:56 +05:30
Dan Helfman
1c51a8e229
Allow defining custom variables in config file (#612). 
Merge pull request #60 from diivi/feat/constants-support
 2023-03-24 22:50:57 -07:00
Dan Helfman
af3431d6ae
fix: docs cli reference create spelling 
Merge pull request #61 from diivi/docs/cli-reference
 2023-03-24 16:09:50 -07:00
Divyansh Singh
61ce6f0473 fix: docs cli reference create spelling 2023-03-25 02:44:56 +05:30
Divyansh Singh
78e8bb6c8c reformat 2023-03-25 02:08:52 +05:30
Divyansh Singh
af95134cd2 add test for complex constant 2023-03-25 02:03:36 +05:30
Divyansh Singh
d6dfb8753a reformat 2023-03-25 01:50:47 +05:30
Divyansh Singh
1bc003560a Merge branch 'master' of https://github.com/diivi/borgmatic into feat/tag-repos 2023-03-25 01:39:26 +05:30
Divyansh Singh
aeaf69f49e pass all tests 2023-03-25 01:34:03 +05:30
Divyansh Singh
e83ad9e1e4 use repository["path"] instead of repository 2023-03-25 01:04:57 +05:30
Dan Helfman
f42890430c Add code style plugins to enforce use of Python f-strings and prevent single-letter variables. 2023-03-23 23:11:14 -07:00
Divyansh Singh
6f300b0079 feat: constants support 2023-03-24 02:39:37 +05:30
Dan Helfman
0a72c67c6c Add missing source directory error fix to NEWS (#655). 2023-03-22 13:02:22 -07:00
Dan Helfman
ab64b7ef67
Fix error when a source directory doesn't exist and databases are configured (#655). 
Merge pull request #56 from diivi/fix/no-error-on-database-backup-without-source-dirs
 2023-03-22 12:59:01 -07:00
Divyansh Singh
1e3a3bf1e7 review 2023-03-23 01:18:06 +05:30
Divyansh Singh
7a2f287918 reformat base 2023-03-23 01:08:30 +05:30
Divyansh Singh
8a63c49498 feat: tag repos 2023-03-23 01:01:26 +05:30
Divyansh Singh
3b5ede8044 remove extra parameter from function call 2023-03-22 23:11:44 +05:30
Divyansh Singh
bd235f0426 use exit_code_indicates_error and modify it to accept a command 2023-03-22 16:23:53 +05:30
Divyansh Singh
09183464cd fix: no error on database backups without source dirs 2023-03-22 09:41:39 +05:30
Dan Helfman
dd9a64f4b6
Fix confusing message when an error occurs running actions for a configuration file (#623). 
Merge pull request #55 from diivi/fix/rephrase-error-message
 2023-03-21 14:23:09 -07:00
Divyansh Singh
23e7f27ee4 fix: rephrase error when running from config 
to avoid confusion, as the user might think the problem is with their config file
 2023-03-22 02:22:43 +05:30
Dan Helfman
f9ef52f9a5 Remove unused module and outdated test expectations (#576). 2023-03-21 10:29:17 -07:00
Divyansh Singh
39ad8f64c4 add tests and remove magic number 2023-03-21 17:06:03 +05:30
Divyansh Singh
e86d223bbf Merge branch 'master' of https://github.com/diivi/borgmatic into feat/file-urls-support 2023-03-21 16:55:05 +05:30
Divyansh Singh
86587ab2dc send repo directly to extract and export_tar 2023-03-20 21:51:45 +05:30
Divyansh Singh
58c95d8015 feat: file:// URLs support 2023-03-20 02:43:23 +05:30
Dan Helfman
b115fb2fbe Merge branch 'master' of github.com:borgmatic-collective/borgmatic 2023-03-18 14:01:52 -07:00
Dan Helfman
31d04d9ee3
Optionally error if a source directory does not exist. 
feat: add optional check for existence of source directories
 2023-03-18 13:59:20 -07:00
Divyansh Singh
f803836416 reformat 2023-03-18 17:27:33 +05:30
Divyansh Singh
997f60b3e6 add tests 2023-03-18 17:24:21 +05:30
Divyansh Singh
d17b2c74db feat: add optional check for existence of source directories 2023-03-18 04:35:55 +05:30
Soumik Dutta
fb9677230b add test to ensure integers are converted to string 
before setting them up to be environment variable values

Signed-off-by: Soumik Dutta <shalearkane@gmail.com>
 2023-03-18 02:57:56 +05:30
Soumik Dutta
0db137efdf add option to set borg_files_cache_ttl in config 
Signed-off-by: Soumik Dutta <shalearkane@gmail.com>
 2023-03-18 01:48:24 +05:30
Nain
5f87ea3ec5 Add "--repository" flag to the "create" action 2023-03-16 13:15:49 -04:00
Nain
a8aeace5b5 Add "--repository" flag to the "compact" action 2023-03-16 11:13:45 -04:00
Nain
480addd7ce Add "--repository" flag to the "check" action 2023-03-16 10:41:13 -04:00
Nain
cdbe6cdf3a Add "--repository" flag to the "prune" action 
part of ticket #564
 2023-03-15 14:43:17 -04:00
Dan Helfman
8cec7c74d8 Add "--strip-components all" on the "extract" action to remove leading path components (#647). 2023-03-09 10:09:16 -08:00
Dan Helfman
b343363bb8 Change the default action order to: "create", "prune", "compact", "check" (#304). 2023-03-08 14:05:06 -08:00
Dan Helfman
9db31bd1e9 Run any command-line actions in the order specified instead of using a fixed ordering (#304). 2023-03-08 13:19:41 -08:00
Dan Helfman
d88bcc8be9 Add Healthchecks "log" state feature to NEWS. 2023-03-07 15:45:23 -08:00
Dan Helfman
332f7c4bb6 Add support for healthchecks "log" feature (#628). 
Reviewed-on: https://projects.torsion.org/borgmatic-collective/borgmatic/pulls/645
 2023-03-07 22:21:30 +00:00
Dan Helfman
5d19d86e4a Add flake8-quotes to complain about incorrect quoting so I don't have to! 2023-03-07 14:08:35 -08:00
Soumik Dutta
044ae7869a fix tests 
Signed-off-by: Soumik Dutta <shalearkane@gmail.com>
 2023-03-08 03:30:12 +05:30
Soumik Dutta
4fcfddbe08 return early if unsupported state is passed 
Signed-off-by: Soumik Dutta <shalearkane@gmail.com>
 2023-03-06 19:58:57 +05:30
Soumik Dutta
45256ae33f add test for healthchecks 
Signed-off-by: Soumik Dutta <shalearkane@gmail.com>
 2023-03-06 03:38:08 +05:30
Soumik Dutta
1573d68fe2 update schema.yaml description 
also add monitor.State.LOG to cronitor.

Signed-off-by: Soumik Dutta <shalearkane@gmail.com>
 2023-03-05 21:57:13 +05:30
Soumik Dutta
69f6695253 Add support for healthchecks "log" feature #628 
Signed-off-by: Soumik Dutta <shalearkane@gmail.com>
 2023-03-05 19:27:32 +05:30
Dan Helfman
e1f02d9fa5 Add SQLite feature to NEWS and also integrations. 2023-03-04 09:59:16 -08:00
Dan Helfman
9ec220c600
Add SQLite database dump/restore hook (#295). 
feat: add dump-restore support for sqlite databases
 2023-03-04 09:47:21 -08:00
Divyansh Singh
cf0275a3ed remove test path 2023-03-04 23:00:57 +05:30
Divyansh Singh
c71eb60cd2 mock os.remove instead of actually removing a file 2023-03-04 13:08:30 +05:30
Divyansh Singh
675e54ba9f use os.remove and improve tests 2023-03-04 12:43:07 +05:30
Divyansh Singh
903507bd03 code review 2023-03-04 01:27:07 +05:30
Dan Helfman
a071e02d20 With the "create" action and the "--list" ("--files") flag, only show excluded files at verbosity 2 (#620). 2023-03-02 15:33:42 -08:00
Divyansh Singh
af1cc27988 feat: add dump-restore support for sqlite databases 2023-03-02 23:55:16 +05:30
Dan Helfman
dbf8301c19 Add "checkpoint_volume" configuration option to creates checkpoints every specified number of bytes. 2023-02-27 10:47:17 -08:00
Dan Helfman
2a36a2a312 Add "--repository" flag to the "rcreate" action. Add "--progress" flag to the "transfer" action. 2023-02-26 23:22:23 -08:00
Dan Helfman
d7a07f0428 Support status character changes in Borg 2.0.0b5 when filtering out special files that cause Borg to hang. 2023-02-26 22:36:13 -08:00
Dan Helfman
da321e180d Fix the "create" action with the "--dry-run" flag querying for databases when a PostgreSQL/MySQL "all" database is configured. 2023-02-26 22:15:12 -08:00
Dan Helfman
c6582e1171 Internally support new Borg 2.0.0b5 "--filter" status characters / item flags for the "create" action. 2023-02-26 17:17:25 -08:00
Dan Helfman
9b83afe491 With the "create" action, only one of "--list" ("--files") and "--progress" flags can be used. 2023-02-26 17:05:56 -08:00
Dan Helfman
8a9d5d93f5 Add ntfy authentication to NEWS. 2023-02-25 14:23:42 -08:00
Tom Hubrecht
9b071ff92f Make the auth logic more explicit and warnings if necessary 2023-02-25 20:04:39 +01:00
Tom Hubrecht
d80e716822 Add authentication to the ntfy hook 2023-02-24 17:35:53 +01:00
Dan Helfman
418ebc8843 Add MySQL database hook "add_drop_database" configuration option to control whether dumped MySQL databases get dropped right before restore (#642). 2023-02-20 15:32:47 -08:00
Dan Helfman
f5a448c7c2 Fix for potential data loss (data not getting backed up) when dumping large "directory" format PostgreSQL/MongoDB databases (#643). 2023-02-20 15:18:51 -08:00
Dan Helfman
30cca62d09 Add configuration options for database command customization (#630). 2023-01-26 14:59:17 -08:00
Dan Helfman
0e6b2c6773 Optionally dump "all" PostgreSQL databases to separate files instead of one combined dump file (#438, #560). 2023-01-25 23:31:07 -08:00
palto42
fd7ad86daa
conditional warning for excluding special files 2023-01-03 21:53:51 +01:00
Dan Helfman
6f3b23c79d Lowercase borgmatic in documentation. 2022-12-23 14:12:48 -08:00
Macguire Rintoul
116f1ab989 add borgmatic minimum version to compact docs 2022-12-23 13:32:01 -08:00
Dan Helfman
5e15c9f2bc Fix traceback when include merging on ARM64 (#622). 2022-12-23 10:07:53 -08:00
Dan Helfman
f67c544be6 Optionally dump "all" PostgreSQL databases to separate files instead of one combined dump file (#438, #560). 2022-12-15 22:59:42 -08:00
Dan Helfman
c657764367 Fix logs that interfere with JSON output by making warnings go to stderr instead of stdout (#602). 2022-12-02 12:12:10 -08:00
Dan Helfman
fd39f54df7 Code formatting. 2022-11-18 08:35:01 -08:00
Dan Helfman
ca7e18bb29
Override PostgreSQL dump/restore commands via configuration options (#311). 
Merge pull request #49 from jpaniagualaconich/specify-pg-dump-restore-commands
 2022-11-18 08:33:14 -08:00
Dan Helfman
6975a5b155 Fix "data" consistency check to support "check_last" and consistency "prefix" options (#611). 2022-11-17 10:19:48 -08:00
Javier Paniagua
faf682ca35 specify pg dump/restore commands (#311) 2022-11-06 11:12:53 +01:00
Dan Helfman
89500df429 Fix traceback when a configuration section is present but lacking any options (#604). 2022-10-23 13:56:03 -07:00
Dan Helfman
9c42e7e817 Fix regression in which "check" action errored on certain systems (#597, #598). 2022-10-14 16:19:26 -07:00
Dan Helfman
953277a066 Fix special file detection when broken symlinks are encountered (#596). 2022-10-14 09:41:08 -07:00
Dan Helfman
c9742e1d04 Code formatting. 2022-10-12 10:52:32 -07:00
Dan Helfman
906da838ef Add missing break-lock action command-line help (#357). 2022-10-12 10:48:10 -07:00
Dan Helfman
d7f1c10c8c To prevent Borg hangs, unconditionally delete stale named pipes before dumping databases (#360). 2022-10-12 10:26:09 -07:00
Dan Helfman
a31ce337e9 Skip auto-exclusion of special files when user explicitly sets read_special to true (#587). 2022-10-06 11:07:43 -07:00
Dan Helfman
c31702d092 Fix for potential data loss with "patterns_from". Also, display excluded files (#590). 2022-10-04 22:57:18 -07:00
Dan Helfman
ba8fbe7a44 Add "break-lock" action for removing any repository and cache locks leftover from Borg aborting (#357). 2022-10-04 13:42:18 -07:00
Dan Helfman
2774c2e4c0 Add support for Borg 2's "--match-archives" flag (replaces "--glob-archives") (#591). 2022-10-03 22:50:37 -07:00
Dan Helfman
ae036aebd7 When the "read_special" option is true or database hooks are enabled, auto-exclude special files for a "create" action to prevent Borg from hanging (#587). 2022-10-03 12:58:13 -07:00
Dan Helfman
ac7c7d4036 Warn when ignoring a configured "read_special" value of false, as true is needed when database hooks are enabled (#587). 2022-09-20 13:52:13 -07:00
Dan Helfman
679bb839d7 Fix hang when database hooks are enabled and "patterns" contains a parent directory of "~/.borgmatic" (#582). 2022-09-08 10:16:42 -07:00
Dan Helfman
9e64d847ef Fix regression in which "borgmatic info --archive ..." showed repository info instead of archive info with Borg 1 (#577). 2022-08-30 20:42:42 -07:00
Dan Helfman
61fb275896 Fix duplicate-appearing log entries for "list" action. 2022-08-30 20:29:26 -07:00
Dan Helfman
87c97b7568 Fixed spurious, intermittent test failures related to command execution and logging. 2022-08-28 09:06:06 -07:00