andrewchambers
Repos
221
Followers
269
Following
94

Ordered process (re)start, shutdown, and supervision.

146
4

A script to do actions based on the current window and selected text.

129
12

SFTP <-> Cloud service bridge.

69
4

terraform provider that manages nix builds and nixos machines.

101
5

A no frills delta debugger written in myrddin.

29
0

Easy and efficient encrypted backups.

699
19

Events

andrewchambers create branch main
Created at 5 hours ago
create repository
andrewchambers create repository
Created at 5 hours ago
issue comment
Panic unwrap SqliteFailure Err

The error message has been improved and will be in the next release.

Created at 5 hours ago

Improve send log error messages.

Created at 1 day ago
send log privacy guarantees

One or both of:

  • Use encrypted sqlite3 for sendlog with
  • Document send log privacy guarantees - list of hmacs only.
Created at 2 days ago
issue comment
FFI win64: passing a struct at slot 1 (arity >= 2) may overwrite the structs first field with 64 (0x40)

Minor observation - this is probably something we can enumerate or fuzz with a small bit of helper code to generate C functions.

Created at 3 days ago

Improve put examples.

Created at 3 days ago

Update documentation.

Created at 3 days ago

Remove debug prints.

Created at 3 days ago
issue comment
Be able to `put` a list of files and directories together in a single snapshot

Nice spotting, forgot to update the docs.

Created at 3 days ago
issue comment
Parallel put pipeline

I Implemented this as it was important for large ceph fs clusters.

Created at 3 days ago
issue comment
kind bupstash and other tools benchmark report

fwiw the next release of bupstash is going to add multi threading which can dramatically improve put times - for me 3x in some cases

Created at 3 days ago
issue comment
Be able to `put` a list of files and directories together in a single snapshot

This has been fixed and will be in the next release.

Created at 3 days ago
Migrating sendlog to use checksumvfs fails

https://sqlite.org/forum/forumpost/e168e116a3 https://github.com/andrewchambers/sqlitecksumvfsreport

Created at 3 days ago
Option to tune or disable dir splits

We force splits on directory boundaries for caching purposes which sometimes creates very small chunks... we should perhaps not split in this case creating a far more favorable chunk distribution.

I think often the stat cache is not valuable for such small directories anyway.

Created at 3 days ago

Add threading to the indexer and put pipeline.

This change rewrites client upload to do multithreaded uploads and adds command line options to control threading. The change set also adds some undocumented benchmarking subcommands.

Created at 3 days ago
pull request closed
Add threading to the indexer and put pipeline.

This change rewrites client upload to do multithreaded uploads and adds command line options to control threading. The change set also adds some undocumented benchmarking subcommands.

Created at 3 days ago
list-contents should stream file contents as they are downloaded
Created at 3 days ago
Progress bar on downloading index

A progress bar would be very useful when fetching the index.

Created at 3 days ago

Add threading to the indexer and put pipeline.

This change rewrites client upload to do multithreaded uploads and adds command line options to control threading. The change set also adds some undocumented benchmarking subcommands.

Created at 3 days ago

Add threading to the indexer and put pipeline.

This change rewrites client upload to do multithreaded uploads and adds command line options to control threading. The change set also adds some undocumented benchmarking subcommands.

Created at 3 days ago
pull request opened
Add threading to the indexer and put pipeline.

This change rewrites client upload to do multithreaded uploads and adds command line options to control threading. The change set also adds some undocumented benchmarking subcommands.

Created at 3 days ago

Add threading to the indexer and put pipeline.

This change rewrites client upload to do multithreaded uploads and adds command line options to control threading. The change set also adds some undocumented benchmarking subcommands.

Created at 3 days ago

Improve put benchmark.

Created at 3 days ago

Update documentation.

Created at 4 days ago
FsWalker keeps paths of largest directory in memory

Currently the FsWalker in indexer.rs keeps all paths of the largest directory in memory - it does this so it can scan for exclusion marker files. This is a bottleneck for more extreme use cases and it would be better to iterate via readdir.

Possible solutions:

  • stat for marker files directly (possibly on a large directory threshold).
  • only keep paths in memory if marker files are being used, otherwise iterate via readdir.
Created at 4 days ago

Remove mmap from sendlog, bump verison.

Created at 4 days ago
issue comment
Fails to build on ARM64 (Termux)

Thanks for investigating this btw - I will try to get setup later and test your investigation too.

Created at 4 days ago