Syncthing

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search
Syncthing
Syncthing logo
Syncthing Logo
Syncthing Web Interface
Syncthing Web Interface
Original author(s) Jakob Borg
Developer(s) Jakob Borg et al.[1]
Initial release 2013-12-15
Stable release
0.14.48[2] / 5 June 2018;
32 days ago
 (2018-06-05)[3]
Repository Edit this at Wikidata
Written in Go
Operating system Linux, OS X, Windows, Android, BSD, Solaris
Available in English, German, Greek, Spanish, French, Italian, Polish, Portuguese, Russian, Swedish, Norwegian
Type File synchronization
License MPL 2.0[4]
Website syncthing.net

Syncthing is a free, open-source peer-to-peer file synchronization application available for Windows, Mac, Linux, Android, Solaris, Darwin, and BSD.[5] It can sync files between devices on a local network, or between remote devices over the Internet. Data security and data safety are built into the design of the software.

Technology[edit]

Syncthing is written in Go and implements its own, equally free Block Exchange Protocol.[6]

Syncthing is a BYO cloud model where the users provide the hardware that the software runs on. It works generally in the same way that Resilio Sync does where the larger the number of mesh devices, the more efficiently data can be transferred. It supports IPv6 and, for those on IPv4 networks, NAT punching and relaying are offered. Devices connecting to each other require explicit approval (unless using the Introducer feature) which increases the security of the mesh. All data, whether transferred directly between devices or via relays, is encrypted using TLS.[7][8]

Conflicts are handled with the older file being renamed with a "sync-conflict" suffix (along with time and date stamp), enabling the user to decide how to manage two or more files of the same name that have been changed between syncing.[9] GUI Wrappers can use these files to present the user with a method of resolving conflicts without having to resort to manual file handling.

Efficient syncing is achieved via compression of metadata or all transfer data,[10] block re-use[11] and lightweight scanning[12] for changed files, once a full hash has been computed and saved. Syncthing offers a "Master Folder" feature[13] where updates from remote devices are not processed, various types of file versioning[14] (trash can, simple or staggered versioning as well as handing versioning to an external program or script) and file/path ignore patterns.[15] Two different SHA256 hashing implementations are currently supported, the faster of which will be used dynamically after a brief benchmark on start-up.[16] Moving and renaming of files and folders is handled efficiently, with Syncthing intelligently processing these operations rather than re-downloading data from scratch.[17]

Infrastructure[edit]

Device discovery is achieved via publicly-accessible discovery servers hosted by the project developers,[18] local (LAN) discovery via broadcast messages, device history and static host name/addressing. The project also provides the Syncthing Discovery Server[19] program for hosting one's own discovery servers, which can be used alongside, or as a replacement of the public servers.

The network of community-contributed relay servers allows devices that are both behind different IPv4 NAT firewalls to be able to communicate by relaying encrypted data via a third party. The relaying performed is similar in nature to the TURN protocol, with the traffic TLS-encrypted end-to-end between devices (thus even the relay server cannot see the data, only the encrypted stream). Private relays can also be set up and configured, with or without public relays, if desired. Syncthing will automatically switch from relaying to direct device-to-device connections if it discovers that a direct connection has become available.[20]

Syncthing can be used without any connection to the project or community's servers:[21] upgrades, opt-in usage data, discovery and relaying can all be disabled and/or configured independently, thus the mesh and its infrastructure can all be run in a closed system for privacy or confidentiality.

Configuration and Management[edit]

Syncthing can be configured via a web UI locally or remotely (and supports access via proxy server), the REST and Events APIs or one of the community-contributed wrapper programs.[22] Links to Docker images are also provided on the community contributions page, as well as links to supported configuration management solutions such as Puppet, Ansible and others.

Reception[edit]

  • If you're looking for an easy way to sync files from your mobile device to your desktop, Jack Wallen shows you how with Syncthing.[5]
  • In episode 456 of SecurityNow!, host Steve Gibson praised Syncthing as a potential open-source replacement for BitTorrent Sync.[23]
  • Android Syncthing only support writing to internal SD card, not external. External SD card sync will not work until GO supports the Android "Storage Access Framework". [24] [25] Annotation: its also possible to use SD-Cards if they are formatted to be used with this device only (encrypted) and set to be the main storage device.

History[edit]

Date Version Major Changes
2016-06-19 0.14 “Dysprosium Dragonfly”[26]
  • new, extensible sync protocol (full rehashing of folder contents will happen on first restart)
2016-05-17 0.13 “Copper Cockroach”[27]
  • Serve files while downloading them
  • Unique folder ID separate from label
2015-11-05 0.12 “Beryllium Bedbug”[28]
  • Connection Relaying
  • Device Discovery over HTTPS
2015-04-22 0.11[29]
  • Conflict Handling
  • CPU Usage Improvements
  • Performance Improvements When Syncing Many Small Files or Very Large Ones
  • External Versioning
2014-10-08 0.10[30]
2014-08-01 0.9[31]
2014-04-14 0.8[32]
2014-03-30 0.7[33]
2014-02-23 0.6[34]

The initial public binary release (v0.2) was made on 30 December 2013.[35]

In October 2014 it was announced by the original author that Syncthing was being rebranded as "Pulse".[36] However, on November 17, the developer decided not to change Syncthing to Pulse and is no longer working with ind.ie. Ind.ie's Pulse is now an officially sanctioned fork of Syncthing.[37]

See also[edit]

References[edit]

  1. ^ "AUTHORS". Retrieved 7 April 2016 – via GitHub. 
  2. ^ "Releases". Retrieved 2018-06-05 – via GitHub. 
  3. ^ "Release v0.14.48". Retrieved 2018-06-05 – via GitHub. 
  4. ^ "LICENSE". Retrieved 7 April 2016 – via GitHub. 
  5. ^ a b Wallen, Jack (5 January 2016). "Let Syncthing turn your desktop into a local cloud for your mobile device". TechRepublic. CBS Interactive. 
  6. ^ "Block Exchange Protocol v1". Retrieved 7 April 2016. 
  7. ^ "Security Principles — Syncthing v0.14 documentation". Docs.syncthing.net. Retrieved 2017-01-04. 
  8. ^ "Relaying — Syncthing v0.14 documentation". Docs.syncthing.net. Retrieved 2017-01-04. 
  9. ^ "FAQ — Syncthing v0.14 documentation". Docs.syncthing.net. Retrieved 2017-01-04. 
  10. ^ "FAQ — Syncthing v0.14 documentation". Docs.syncthing.net. Retrieved 2017-01-04. 
  11. ^ "Understanding Synchronization — Syncthing v0.14 documentation". Docs.syncthing.net. Retrieved 2017-01-04. 
  12. ^ "Understanding Synchronization — Syncthing v0.14 documentation". Docs.syncthing.net. Retrieved 2017-01-04. 
  13. ^ "Archived copy". Archived from the original on 2016-11-30. Retrieved 2016-11-29. 
  14. ^ "File Versioning — Syncthing v0.14 documentation". Docs.syncthing.net. Retrieved 2017-01-04. 
  15. ^ "Ignoring Files — Syncthing v0.14 documentation". Docs.syncthing.net. Retrieved 2017-01-04. 
  16. ^ "cmd/syncthing: Add selectable sha256 package (fixes #3613, fixes #3614)". Github.com. 2016-09-22. Retrieved 2017-01-04. 
  17. ^ "FAQ — Syncthing v0.14 documentation". Docs.syncthing.net. Retrieved 2017-01-04. 
  18. ^ "Understanding Device IDs — Syncthing v0.14 documentation". Docs.syncthing.net. Retrieved 2017-01-04. 
  19. ^ "Syncthing Discovery Server — Syncthing v0.14 documentation". Docs.syncthing.net. Retrieved 2017-01-04. 
  20. ^ "Relaying — Syncthing v0.14 documentation". Docs.syncthing.net. Retrieved 2017-01-04. 
  21. ^ "Security Principles — Syncthing v0.14 documentation". Docs.syncthing.net. Retrieved 2017-01-04. 
  22. ^ "Community Contributions — Syncthing v0.14 documentation". Docs.syncthing.net. Retrieved 2017-01-04. 
  23. ^ "Security Now!". Grc.com. Retrieved 4 November 2014. 
  24. ^ "Writing to external SD card in Android 5.0 and above". Syncthing Forum. Retrieved 2017-05-03. 
  25. ^ "x/mobile: Android Storage Access Framework support · Issue #10588 · golang/go". GitHub. Retrieved 2017-05-03. 
  26. ^ "0.14". Github.com. 19 June 2016. 
  27. ^ "0.13". Github.com. 17 May 2016. 
  28. ^ "0.12". 14 April 2016. 
  29. ^ "0.11". Github.com. 14 April 2016. 
  30. ^ "0.10". Github.com. 14 April 2016. 
  31. ^ "0.9". Github.com. 14 April 2016. 
  32. ^ "0.8". Github.com. 14 April 2016. 
  33. ^ "0.7". Github.com. 14 April 2016. 
  34. ^ "0.6". Github.com. 14 April 2016. 
  35. ^ "Releases". 30 December 2013 – via GitHub. 
  36. ^ Borg, Jakob (9 October 2014). "Introducing Pulse, and ind.ie". Retrieved 7 April 2016. 
  37. ^ Borg, Jakob (17 November 2014). "Syncthing is still Syncthing". Retrieved 7 April 2016. 

External links[edit]