Derek McGowan
487d77ff50
Fix transfer unpack defaults on darwin
...
Fix the default unpack configuration on darwin to a usable
configuration.
Signed-off-by: Derek McGowan <derek@mcg.dev >
2025-11-18 08:51:51 -08:00
Henry Wang
0198b87fcf
Implement parallel unpack
...
Signed-off-by: Henry Wang <henwang@amazon.com >
2025-10-24 17:54:26 +00:00
Derek McGowan
4f7c69ae67
Update differ selection in transfer service to prefer default
...
Currently the erofs differ will be chosen and cause pulls to fail with
not implemented errors.
Signed-off-by: Derek McGowan <derek@mcg.dev >
2025-06-02 22:54:30 -07:00
Henry Wang
1282299751
Enable DuplicationSuppressor in transfer service
...
Signed-off-by: Henry Wang <henwang@amazon.com >
2025-05-29 22:28:43 +00:00
Adrien Delorme
413702b7e4
fix comment
...
Signed-off-by: Adrien Delorme <azr@users.noreply.github.com >
2025-04-30 10:20:26 +02:00
Fu Wei
ef7bdf18a1
Merge pull request #10177 from azr/azr/parallel-layer-fetch
...
Multipart layer fetch
2025-04-24 20:35:00 +00:00
Phil Estes
25d1d30e6c
Merge pull request #11744 from dmcgowan/unpack-rootfs-types
...
Add support for unpacking custom media types
2025-04-24 14:11:00 +00:00
Adrien Delorme
72c8c7708c
only keep one setting: concurrent_layer_fetch_buffer
...
Signed-off-by: Adrien Delorme <azr@users.noreply.github.com >
2025-04-24 11:41:33 +02:00
Adrien Delorme
88116b1911
remove max_dl_operations setting
...
Signed-off-by: Adrien Delorme <azr@users.noreply.github.com >
2025-04-24 11:39:42 +02:00
Adrien Delorme
f9af08820b
perf(pull): multipart layer fetch
...
Signed-off-by: Adrien Delorme <azr@users.noreply.github.com >
Co-Authored-By: Corentin REGAL <143578+co42@users.noreply.github.com >
2025-04-24 11:39:42 +02:00
Derek McGowan
cdd7ec40db
Support configuring custom media types for unpack
...
Signed-off-by: Derek McGowan <derek@mcg.dev >
2025-04-23 21:19:07 -07:00
Tony Fang
b694be29a0
Update CRI image service to pull using transfer service
...
- adds a transfer service progress reporter to handle timeouts. Also other test fixes
- fallback to local image pull when configuration conflict
Signed-off-by: Tony Fang <nhfang@amazon.com >
Co-authored-by: Swagat Bora <sbora@amazon.com >
2025-04-23 18:18:27 +00:00
Henry Wang
a083b669c9
Set default differ for the default unpack config of transfer service
...
Signed-off-by: Henry Wang <henwang@amazon.com >
2025-04-01 22:39:49 +00:00
Derek McGowan
63f6047282
Add snapshotter exports to unpack platform
...
Allows the unpack operation to be optimized based on the specific
snapshotter configuration.
Signed-off-by: Derek McGowan <derek@mcg.dev >
2025-01-07 16:04:44 -08:00
Derek McGowan
fe01cad201
Cleanup local transfer interface
...
Signed-off-by: Derek McGowan <derek@mcg.dev >
2024-05-02 15:45:49 -07:00
Brian Goff
e41e9e11b5
transfer: Platform matcher should match multiple platforms
...
This allows arm64 to pull armhf images.
Before this change the transfer service would reject pulls for armhf on
an arm64 machine, or indeed any such platform variant mismatches.
I would argue that its a bit weird for the transfer service to reject a
pull at all since there are legitamate reasons to want to pull images
for other architectures, however that's a more philosophical change.
In the case where I ran into this, I have an arm64 machine running
an armhf containerd in an armhf container (for running some basic sanity
checks during packaging).
Tests started failing once `ctr` was moved to use the transfer service
by default.
Signed-off-by: Brian Goff <cpuguy83@gmail.com >
2024-03-21 14:59:17 +00:00
Derek McGowan
f46aea6187
Move transfer and unpack packages
...
Packages related to transfer and unpacking provide core interfaces which
use other core interfaces and part of common functionality.
Signed-off-by: Derek McGowan <derek@mcg.dev >
2024-02-07 22:40:15 -08:00
James Sturtevant
81409e9373
Add a default differ that matches the snapshotter
...
Signed-off-by: James Sturtevant <jsturtevant@gmail.com >
2024-01-30 14:34:58 -08:00
Derek McGowan
fb9b59a843
Switch to new errdefs package
...
Signed-off-by: Derek McGowan <derek@mcg.dev >
2024-01-25 22:18:45 -08:00
Derek McGowan
f2765617c5
Merge pull request #9662 from dmcgowan/replace-platform-package
...
Use github.com/containerd/platforms package
2024-01-23 19:50:25 +00:00
Derek McGowan
e79ec7a095
Remove deprecated platforms package
...
Signed-off-by: Derek McGowan <derek@mcg.dev >
2024-01-23 09:14:03 -08:00
Derek McGowan
cf6f439eb0
Fix transfer plugin unpack configuration
...
Remove default unpack configuration to prevent duplication of
configuration from toml decoder appending to the default. When no unpack
configuration is provided, use the default.
Signed-off-by: Derek McGowan <derek@mcg.dev >
2024-01-18 06:46:49 -08:00
Derek McGowan
44a836c9b5
Move errdefs to pkg/errdefs
...
Signed-off-by: Derek McGowan <derek@mcg.dev >
2024-01-17 09:54:45 -08:00
Derek McGowan
1a1e0e8c81
Move metadata to core/metadata
...
Signed-off-by: Derek McGowan <derek@mcg.dev >
2024-01-17 09:52:03 -08:00
Derek McGowan
f80760f9ff
Move leases to core/leases
...
Signed-off-by: Derek McGowan <derek@mcg.dev >
2024-01-17 09:51:45 -08:00
Derek McGowan
913edcd489
Move diff to core/diff
...
Signed-off-by: Derek McGowan <derek@mcg.dev >
2024-01-17 09:51:17 -08:00
James Jenkins
8aa2551ce0
Move DefaultSnapshotter constants
...
Move the DefaultSnapshotter constants to the defaults package.
Fixes issue #8226 .
Signed-off-by: James Jenkins <James.Jenkins@ibm.com >
2024-01-12 13:28:46 -05:00
Derek McGowan
9db21401c4
Switch to github.com/containerd/plugin
...
Signed-off-by: Derek McGowan <derek@mcg.dev >
2023-11-01 23:01:42 -07:00
Derek McGowan
261e01c2ac
Move client to subpackage
...
Signed-off-by: Derek McGowan <derek@mcg.dev >
2023-11-01 10:37:00 -07:00
Derek McGowan
5fdf55e493
Update go module to github.com/containerd/containerd/v2
...
Signed-off-by: Derek McGowan <derek@mcg.dev >
2023-10-29 20:52:21 -07:00
Derek McGowan
7b2a918213
Generalize the plugin package
...
Remove containerd specific parts of the plugin package to prepare its
move out of the main repository. Separate the plugin registration
singleton into a separate package.
Separating out the plugin package and registration makes it easier to
implement external plugins without creating a dependency loop.
Signed-off-by: Derek McGowan <derek@mcg.dev >
2023-10-12 21:22:32 -07:00
Derek McGowan
a80606bc2d
Move plugin type definitions to containerd plugins package
...
The plugins packages defines the plugins used by containerd.
Move all the types and properties to this package.
Signed-off-by: Derek McGowan <derek@mcg.dev >
2023-10-12 20:52:56 -07:00
Derek McGowan
508aa3a1ef
Move to use github.com/containerd/log
...
Add github.com/containerd/log to go.mod
Signed-off-by: Derek McGowan <derek@mcg.dev >
2023-09-22 07:53:23 -07:00
Ethan Lowman
ac1d556b92
Add image verifier transfer service plugin system based on a binary directory
...
Signed-off-by: Ethan Lowman <ethan.lowman@datadoghq.com >
2023-09-07 18:45:02 -04:00
Derek McGowan
c786994eae
Update transfer configuration
...
Export transfer config fields.
Determine differ based on platform or config.
Get snapshotter from metadata store.
Signed-off-by: Derek McGowan <derek@mcg.dev >
2023-04-19 18:00:23 -07:00
Ethan Lowman
3e87f05b62
Fix image pulling with Transfer service
...
Signed-off-by: Ethan Lowman <ethan.lowman@datadoghq.com >
2023-03-15 16:10:31 -04:00
Tony Fang
2e96ba95e0
Create config struct to take user input
...
Signed-off-by: Tony Fang <nhfang@amazon.com >
2023-03-02 05:44:25 +00:00
Tony Fang
47305392c6
Add configuration options to local transfer service
...
Signed-off-by: Tony Fang <nhfang@amazon.com >
2023-02-25 03:40:06 +00:00
Derek McGowan
01bd314b1d
Rename local transfer plugin
...
Signed-off-by: Derek McGowan <derek@mcg.dev >
2022-11-30 12:56:58 -08:00
Derek McGowan
478f1c934d
Lint fixes
...
Signed-off-by: Derek McGowan <derek@mcg.dev >
2022-11-30 12:56:55 -08:00
Derek McGowan
6b5df1ee16
Update transfer packages
...
Signed-off-by: Derek McGowan <derek@mcg.dev >
2022-11-30 12:56:54 -08:00
Derek McGowan
6f64cb8598
Transfer interface and plugin work in progress
...
Signed-off-by: Derek McGowan <derek@mcg.dev >
Transfer service implementation
Signed-off-by: Derek McGowan <derek@mcg.dev >
2022-11-30 12:56:50 -08:00