ma-hartma

ma-hartma

dotnet, go

Member Since 2 years ago

Freelancing, Augsburg, Germany

Experience Points
30
follower
Lessons Completed
45
follow
Lessons Completed
334
stars
Best Reply Awards
12
repos

175 contributions in the last year

Pinned
⚡ A data storage & backup system
⚡ knoxite.com
Activity
Dec
5
19 hours ago
Activity icon
delete

ma-hartma in knoxite/website delete branch completion

deleted time in 2 hours ago
pull request

ma-hartma merge to knoxite/knoxite

ma-hartma
ma-hartma

Add initial `set-url` command

This has been tested successfully with migrating a knoxite repository from s3s://... to amazons3://.... On its own, this is not enough for us to rename the s3(s) backend to minio and amazons3 to s3.

In the set-url command, we roughly do the following:

  • open the repository at the URL passed in via the -r flag
  • create a "fake" backend from the -r Flag in order to normalize the URL through the backend.
  • remove the backend that matches the normalized URL
  • add a new backend with the new URL
  • save the repository

For Testing, I did the following:

  • Create a repository using the s3s backend, initialize a volume and upload some files
  • Through the AWS CLI, I copied the contents of the S3 buckets created by the s3 backend to one new S3 bucket:
    • aws s3 cp "s3://knoxite-oldbackend-test-repository/repository.knoxite" s3://jfuermann-knoxite-test-new/repository.knoxite
    • aws s3 cp --recursive "s3://knoxite-oldbackend-test-snapshots/" s3://jfuermann-knoxite-test-new/snapshots
    • aws s3 cp --recursive "s3://knoxite-oldbackend-test-chunks/" s3://jfuermann-knoxite-test-new/chunks
  • /knoxite repo -r "s3s://s3.amazonaws.com/eu-west-1/knoxite-oldbackend-test" set-url amazons3://jfuermann-knoxite-test-new/

After merging this PR, users can migrate their backups to the new S3 backend, the handler naming topic (s3 vs. amazons3) remains unsolved.

To Do:

  • Print known locations when oldLocation is not found
  • Add documentation for set-url to website
Activity icon
issue

ma-hartma issue comment knoxite/knoxite

ma-hartma
ma-hartma

Add initial `set-url` command

This has been tested successfully with migrating a knoxite repository from s3s://... to amazons3://.... On its own, this is not enough for us to rename the s3(s) backend to minio and amazons3 to s3.

In the set-url command, we roughly do the following:

  • open the repository at the URL passed in via the -r flag
  • create a "fake" backend from the -r Flag in order to normalize the URL through the backend.
  • remove the backend that matches the normalized URL
  • add a new backend with the new URL
  • save the repository

For Testing, I did the following:

  • Create a repository using the s3s backend, initialize a volume and upload some files
  • Through the AWS CLI, I copied the contents of the S3 buckets created by the s3 backend to one new S3 bucket:
    • aws s3 cp "s3://knoxite-oldbackend-test-repository/repository.knoxite" s3://jfuermann-knoxite-test-new/repository.knoxite
    • aws s3 cp --recursive "s3://knoxite-oldbackend-test-snapshots/" s3://jfuermann-knoxite-test-new/snapshots
    • aws s3 cp --recursive "s3://knoxite-oldbackend-test-chunks/" s3://jfuermann-knoxite-test-new/chunks
  • /knoxite repo -r "s3s://s3.amazonaws.com/eu-west-1/knoxite-oldbackend-test" set-url amazons3://jfuermann-knoxite-test-new/

After merging this PR, users can migrate their backups to the new S3 backend, the handler naming topic (s3 vs. amazons3) remains unsolved.

To Do:

  • Print known locations when oldLocation is not found
  • Add documentation for set-url to website
ma-hartma
ma-hartma

Documentation was just added to the website (https://github.com/knoxite/website/pull/73) and the PR is ready for merge.

pull request

ma-hartma pull request knoxite/website

ma-hartma
ma-hartma

Add documentation for set-url command

Add documentation for set-url command https://github.com/knoxite/knoxite/pull/197.

push

ma-hartma push knoxite/website

ma-hartma
ma-hartma

Add documentation for set-url command

commit sha: cb2990b1f2ad83e5f6a6b0dc7d6c49d2a87b949e

push time in 16 hours ago
Activity icon
created branch

ma-hartma in knoxite/website create branch set-url

createdAt 16 hours ago
Activity icon
issue

ma-hartma issue knoxite/knoxite

ma-hartma
ma-hartma

Rename `clone` command to `extend` and let `clone" copy a repo to a new backend

After re-evaluating #160 we came to the conclusion to rename the clone command to "extend", since the command seems to confuse many users.

Activity icon
issue

ma-hartma issue comment knoxite/knoxite

ma-hartma
ma-hartma

Verbose Flag

A verbose output flag -v | --verbose could be useful in a lot of cases in order to retrace what knoxite is doing

Activity icon
issue

ma-hartma issue knoxite/knoxite

ma-hartma
ma-hartma

Tests for new outputs and renderers

Tests for outputs and renderers which are currently in work on https://github.com/knoxite/knoxite/tree/verbose-flag after #132 was solved.

Activity icon
issue

ma-hartma issue knoxite/knoxite

ma-hartma
ma-hartma

Docs for new outputs and renderers

Docs for outputs and renderers which are currently in work on https://github.com/knoxite/knoxite/tree/verbose-flag after #132 was solved.

pull request

ma-hartma pull request knoxite/website

ma-hartma
ma-hartma

Remove GitHub pages workflow

Activity icon
created branch

ma-hartma in knoxite/website create branch no-gh-pages

createdAt 19 hours ago
Activity icon
delete

ma-hartma in knoxite/website delete branch gh-pages

deleted time in 19 hours ago
started
started time in 19 hours ago
Dec
4
1 day ago
started
started time in 1 day ago
started
started time in 1 day ago
Dec
3
2 days ago
started
started time in 2 days ago
Dec
2
3 days ago
started
started time in 3 days ago
started
started time in 3 days ago
Dec
1
4 days ago
started
started time in 3 days ago
started
started time in 3 days ago
started
started time in 3 days ago
started
started time in 3 days ago
started
started time in 3 days ago
started
started time in 3 days ago
started
started time in 4 days ago
started
started time in 4 days ago
Previous