Commit Graph

247 Commits

Author SHA1 Message Date
Christoph Klaffl 1053e9370e
missed sudo command for bookmark creation if source host is remote 2019-02-01 17:43:04 +01:00
Christoph Klaffl f0fec5348e
fix root pool parsing for remote hosts 2019-01-31 18:25:41 +01:00
Christoph Klaffl c5eebbe81d
implemented parsing of provided zfs send/recv options and whitelisting for each use case as needed 2019-01-31 18:14:35 +01:00
Christoph Klaffl 5107380cb3
codestyle 2019-01-31 00:47:13 +01:00
Christoph Klaffl d68d7b4afa
implemented creation of zfs bookmarks 2019-01-31 00:45:12 +01:00
Christoph Klaffl 7141eab594
fix bookmark edge case where replication was already done to the latest snapshot (+ test) 2019-01-30 23:49:38 +01:00
Christoph Klaffl 132c765e28
error out if no datasets are processed with recursive arg 2019-01-25 23:58:12 +01:00
Christoph Klaffl 85561ddcda
handle the case of mistyped dataset name nicely 2019-01-25 23:46:58 +01:00
Christoph Klaffl c12b6d716b
check pool capability for resumeable replication instead of checking for support in the zfs module 2019-01-25 23:25:22 +01:00
Christoph Klaffl 02219b0fcf
Merge branch 'master' into path 2019-01-25 16:10:47 +01:00
Christoph Klaffl 6f5e8463c2
Merge branch 'master' into silence-excludes 2019-01-25 16:09:57 +01:00
Jim Salter cd99c5f322
Merge pull request #295 from clinta/zfs_send_recv_options
Added in --sendoptions=OPTIONS and --recvoptions=OPTIONS to inject OP…
2019-01-22 15:04:09 -05:00
Jim Salter 252d496893
Merge pull request #313 from TerraTech/pr/mbuffer_size_option
syncoid: add '--mbuffer-size' option
2019-01-22 15:03:30 -05:00
Christoph Klaffl e4e90659a1
removed debug output from excludes loop 2019-01-07 12:08:55 +01:00
WG Dev f941d7f782 fix for #316 - CRITICAL ERROR: bookmarks couldn't be listed for <volume> 2019-01-06 10:46:24 +01:00
Matthew Swabey bd4eb491d8 Added in --sendoptions=OPTIONS and --recvoptions=OPTIONS to inject OPTIONS enabling things like syncoid --sendoptions=-Lcep and syncoid --recvoptions="-x property"
Co-authored-by: Clint Armstrong <clint@clintarmstrong.net>
2018-12-23 11:13:47 -05:00
root ca76f4268b syncoid: add '--mbuffer-size' option 2018-12-23 09:18:49 -05:00
Christoph Klaffl c2220145e1
Merge branch 'master' into reset-resume-state 2018-12-19 01:32:15 +01:00
Gionatan Danti 8568ac3e10 Fix missing coma 2018-12-10 11:21:43 +01:00
Christoph Klaffl 89f1d4e9a6
run compress commands bare too 2018-12-08 14:13:54 +01:00
Gionatan Danti 210e0aae64 Introduced (un)forced recv when using bookmarks also 2018-12-07 17:38:45 +01:00
Christoph Klaffl 941a770c12
updated comment regarding command existence check 2018-12-07 17:05:53 +01:00
Christoph Klaffl be50481374
use more portable/POSIX compatible ways to check for command existence 2018-12-07 17:03:49 +01:00
Christoph Klaffl 265b32b4b6
Merge branch 'master' into path 2018-12-07 16:54:59 +01:00
Gionatan Danti 1ed37e9891 Resolve a conflict 2018-12-06 09:26:22 +01:00
Gionatan Danti 17be840590 Updated to latest upstream 2018-12-06 09:18:29 +01:00
Christoph Klaffl 5fd4ff04bb
Merge branch 'master' into prepare-release 2018-12-04 23:42:18 +01:00
Christoph Klaffl e162433389
Merge branch 'master' into prepare-release 2018-12-04 23:11:36 +01:00
Christoph Klaffl 0c217ced8b
Merge branch 'master' into force-delete 2018-12-04 22:15:54 +01:00
Jim Salter 7f8055df5d
Merge pull request #254 from spheenik/master
Add xz compression
2018-12-04 16:07:45 -05:00
Christoph Klaffl be3cbb0e77
Merge branch 'master' into master 2018-12-04 22:03:06 +01:00
Ben Wolsieffer 7d742914e5 Add '--no-privilege-elevation' option to bypass root check. 2018-12-04 15:57:00 -05:00
Jim Salter bb79e7b5ec
Merge pull request #247 from phreaker0/bookmarks
implemented support for zfs bookmarks as fallback
2018-12-04 15:49:00 -05:00
Jim Salter f58ef21842
Merge pull request #290 from phreaker0/replicate-clones
replicate clones
2018-12-04 15:13:39 -05:00
Jim Salter f61d552631
Merge pull request #265 from phreaker0/lz4
add lz4 compression
2018-12-04 15:12:20 -05:00
Christoph Klaffl f153810d08
check for valid estimated send size to prevent a perl warning on systems which doesn't output size informations 2018-11-21 23:14:30 +01:00
Christoph Klaffl 9d6cb42f4d
added option to disable smart clone handling 2018-11-21 18:08:38 +01:00
Christoph Klaffl c8b880c5e2
implemented clone handling (try to recreate on target instead of full replication) 2018-11-21 18:01:40 +01:00
Gionatan Danti f04be06f39 Fixed indentation 2018-09-26 14:24:38 +02:00
Christoph Klaffl 9b2c2f29dc
don't use hardcoded paths 2018-09-12 10:00:09 +02:00
Christoph Klaffl d5f4d1c121
add lz4 compression 2018-09-05 19:01:15 +02:00
Christoph Klaffl 2fe97f13ad
prepare for v1.4.19 release 2018-09-05 10:07:05 +02:00
Christoph Klaffl f39ed1ec49
for remote target/source it's required to specify a user 2018-09-03 18:32:17 +02:00
Gionatan Danti df69c033d2 Merge branch 'master' of https://github.com/jimsalterjrs/sanoid 2018-08-16 15:43:56 +02:00
Martin Schrodt f51bb9db7e add xz compression 2018-08-15 16:07:01 +02:00
Christoph Klaffl a9e540ebcd
Merge branch 'master' into reset-resume-state 2018-08-08 00:43:00 +02:00
Christoph Klaffl 16613b604d
Merge branch 'bookmarks' into force-delete 2018-08-08 00:22:21 +02:00
Christoph Klaffl 7070d81775
Merge branch 'master' into bookmarks 2018-08-08 00:21:24 +02:00
Jim Salter eeedf38d57
Merge pull request #189 from attie/nosync
added ability to skip datasets... simply set syncoid:no-sync=true
2018-08-07 17:40:38 -04:00
Jim Salter 295b79ae14
Merge pull request #190 from attie/quiet
--quiet is not quiet
2018-08-07 17:37:46 -04:00
Attie Grande d0ba0bc284 handled empty syncoid:sync property - behaves like unset 2018-08-06 14:17:48 +01:00
Attie Grande f0a37310a5 implemented sync true/false/${HOSTS} filtering 2018-08-03 09:40:11 +01:00
Attie Grande c188e47a6d inverted sync/no-sync logic 2018-08-03 09:40:11 +01:00
Attie Grande b02b9a582b now obeying --quiet, and added 'INFO: ' prefix to skip message 2018-08-03 09:40:11 +01:00
Attie Grande 39d1fd38c1 added ability to skip datasets... simply set syncoid:no-sync=true 2018-08-03 09:40:11 +01:00
Attie Grande fb8edad885 compression warnings are no longer hidden by --quiet 2018-08-03 09:13:35 +01:00
Christoph Klaffl 9668567a87
continue replication on more critical errors 2018-07-30 22:53:48 +02:00
Christoph Klaffl 63eec4994c
don't die on some critical sync errors, but continue to replicate all the other datasets.
after all is done exit with an error code
2018-07-30 22:21:14 +02:00
Christoph Klaffl 020f57cb74
check for error while listing snapshots/bookmarks as this can be dangerous with force-delete 2018-07-30 09:43:03 +02:00
Christoph Klaffl 1cb1209c78
documented force-delete flag 2018-07-30 09:13:26 +02:00
Christoph Klaffl 7c68ef5e8f
return a non zero exit code if there was a problem replicating datasets 2018-07-29 13:16:53 +02:00
Christoph Klaffl 089516c58e
implemented force-delete flag to let syncoid destroy target datasets without matching snapshots/bookmarks 2018-07-29 12:43:46 +02:00
Christoph Klaffl 99dcf7f340
implemented support for zfs bookmarks, if no matching snapshots are found bookmarks are tried as fallback,
both stream and no-stream cases are supported
2018-07-27 22:52:36 +02:00
Jim Salter d1153a244f
Merge pull request #245 from phreaker0/local-source-bwlimit-fix
fix typo to make local source bwlimit work
2018-07-26 16:16:04 -04:00
Jim Salter f3996e0d99
Merge pull request #246 from phreaker0/typo
fixed typo
2018-07-26 16:15:08 -04:00
Christoph Klaffl e85c375bbe
fixed typo 2018-07-26 21:53:56 +02:00
Christoph Klaffl f5508a2403
fix typo to make local source bwlimit work 2018-07-26 21:46:50 +02:00
Christoph Klaffl abf3d458ff
check for partial resume state for non resume style transfers, if so reset state and retry 2018-07-26 21:43:09 +02:00
root 1371afa0e6 Merge branch 'master' of https://github.com/jimsalterjrs/sanoid 2018-07-24 11:10:59 +02:00
Piotr Paczynski 75d8174e69 Fix 'resume support' detection on FreeBSD 2018-07-18 01:21:22 +02:00
shodanshok 7171030bd0
Merge branch 'master' into master 2018-07-10 12:37:52 +02:00
Christoph Klaffl dc0afebb30
allow extra identifier to contain all characters for snapshots names which are allowed by zfs 2018-07-07 20:06:17 +02:00
Christoph Klaffl b32d5a6833
Merge remote-tracking branch 'upstream/master' into extra-identifier 2018-07-07 20:04:40 +02:00
Christoph Klaffl 77e066b3d6
Merge branch 'master' into skip-parent 2018-06-29 08:13:12 +02:00
shodanshok 10d15ef2f1
Merge branch 'master' into master 2018-06-29 00:01:32 +02:00
Jim Salter 21722c34b9
Merge pull request #208 from danielewood/patch-1
Added support for ZStandard compression.
2018-06-28 16:01:00 -04:00
Jim Salter c909f55bc4
Merge pull request #229 from UnlawfulMonad/master
Fix --help typo
2018-06-28 15:59:38 -04:00
Jim Salter 5e291b6f41
Merge pull request #238 from phreaker0/parser-fixes
correctly parse zfs column output (space can be included in the values)
2018-06-28 15:58:43 -04:00
Christoph Klaffl 1f88580199
implemented support for excluding datasets from replication with a regular expression 2018-06-28 17:45:18 +02:00
Christoph Klaffl 34b942ea45
correctly parse zfs column output (space can be included in the values) 2018-06-21 18:18:28 +02:00
Christoph Klaffl 0f8fee7637
added option for using extra identification in the snapshot name for replicating to multiple targets 2018-06-19 19:43:36 +02:00
Christoph Klaffl 70b259ac3c
typos 2018-06-19 18:24:34 +02:00
Christoph Klaffl c0c3050076
added option for skipping the parent dataset in recursive replication 2018-06-19 18:21:06 +02:00
Gionatan Danti 0aaac42057 skip pruning with --no-sync-snap (as by PR #218) 2018-06-11 10:16:18 +02:00
Gionatan Danti f9049085c8 Added "no-rollback" option to prevent any rollback on target host 2018-06-11 09:48:45 +02:00
Lucas Salibian e65879d1f8 Fix --help typo 2018-06-08 11:52:52 -04:00
Christoph Klaffl 63979973b2
if syncoid is instructed to skip snapshot creation it shouldn't attempt to prune existing ones 2018-05-02 00:15:14 +02:00
Gionatan Danti 679f1f3bda Reintroduced targetfsescaped 2018-05-01 09:39:35 +02:00
Gionatan Danti 793f1c782b Reintroduced escapeshellparam for remote command and updated README file 2018-05-01 09:32:18 +02:00
Gionatan Danti 670e76458c Reintroduce "no-resume", erroneously removed from previous commit 2018-04-30 22:45:05 +02:00
Gionatan Danti 2f518d3209 Update to current sanoid master and solved a (fake ?) confict in syncoid 2018-04-30 22:31:27 +02:00
Gionatan Danti f670631ca2 Added "no-clone-rollback" option to prevent clone rollback on target host 2018-04-30 21:50:17 +02:00
root 72245338a8 special character handling and resumable zfs receive support in syncoid 2018-04-25 15:21:56 -04:00
root 2732392088 fix use of uninitialized value in escapeshellparam() 2018-04-25 15:18:00 -04:00
root 4ebc0abef5 fix use of uninitialized string in escapeshellparam() 2018-04-25 14:58:35 -04:00
Christoph Klaffl 944a718351
Merge branch 'master' into resumeable-replication 2018-04-25 18:03:14 +02:00
Christoph Klaffl e6eec0aca0
fix snapshot list generation and incremental sync for snapshots containing whitespaces 2018-04-25 17:15:55 +02:00
Christoph Klaffl 1b5ab20b0d
use resumeable zfs send/receive as default if supported by source and target 2018-04-25 14:58:01 +02:00
danielewood ecf2a852b5
Added support for ZStandard compression.
Available in all major distros with a simple yum/apt-get/pkg.

References: 
ZSTD Compression by Allan Jude - https://www.youtube.com/watch?v=hWnWEitDPlM
Zstandard - https://facebook.github.io/zstd/
2018-04-12 17:43:08 -07:00
Christoph Klaffl d5f4b5abba
support resumable zfs send/receive 2018-02-13 18:47:55 +01:00