Skip to content

Update endpoint#4

Open
jburel wants to merge 3 commits intoome:mainfrom
jburel:update_url
Open

Update endpoint#4
jburel wants to merge 3 commits intoome:mainfrom
jburel:update_url

Conversation

@jburel
Copy link
Copy Markdown
Member

@jburel jburel commented Apr 2, 2026

Update endpoint to livingobjects

@pwalczysko
Copy link
Copy Markdown
Member

Notebook:
Cellpose_parallel.ipynb

Cell executed (in Colab from this branch)

%%time 
name = 'bia-integrator-data/S-BIAD338/804b2976-1111-4099-8bfc-21d1d1d2163c/804b2976-1111-4099-8bfc-21d1d1d2163c.zarr/0'
data = load_binary_from_s3(name)

Error:

ClientResponseError                       Traceback (most recent call last)

<timed exec> in <module>

[/tmp/ipykernel_900/441810667.py](https://localhost:8080/#) in load_binary_from_s3(name, resolution)
      3 def load_binary_from_s3(name, resolution='0'):
      4     root = '%s/%s/' % (name, resolution)
----> 5     return da.from_zarr(ENPOINT_URL + root)

11 frames

[/usr/local/lib/python3.12/dist-packages/aiohttp/client_reqrep.py](https://localhost:8080/#) in raise_for_status(self)
    634                 self.release()
    635 
--> 636             raise ClientResponseError(
    637                 self.request_info,
    638                 self.history,

ClientResponseError: 403, message='Forbidden', url='https://livingobjects.ebi.ac.uk/bia-integrator-data/S-BIAD338/804b2976-1111-4099-8bfc-21d1d1d2163c/804b2976-1111-4099-8bfc-21d1d1d2163c.zarr/0/0/.zarray'

@pwalczysko
Copy link
Copy Markdown
Member

pwalczysko commented Apr 2, 2026

Notebook:
Cellpose_parallel.ipynb

Cell (markdown)

Lazy Loading of data

To find the name, go to [https://livingobjects.ebi.ac.uk/bia-integrator-data/pages/S-BIAD338/804b2976-1111-4099-8bfc-21d1d1d2163c.html](https://www.google.com/url?q=https%3A%2F%2Flivingobjects.ebi.ac.uk%2Fbia-integrator-data%2Fpages%2FS-BIAD338%2F804b2976-1111-4099-8bfc-21d1d1d2163c.html). Click on Copy S3 URI to clipboard, paste it here or into a text editor and remove the endpoint, i.e. the [https://livingobjects.ebi.ac.uk](https://www.google.com/url?q=https%3A%2F%2Flivingobjects.ebi.ac.uk).

The workflow as described ^^^ does not wfm. Going to the url suggested is just erroring.

<Error>
<Code>AccessDenied</Code>
<Message>Access Denied.</Message>
<Key>
pages/S-BIAD338/804b2976-1111-4099-8bfc-21d1d1d2163c.html
</Key>
<BucketName>bia-integrator-data</BucketName>
<Resource>
/bia-integrator-data/pages/S-BIAD338/804b2976-1111-4099-8bfc-21d1d1d2163c.html
</Resource>
<RequestId>18A2854C4737377E</RequestId>
<HostId>54b010ed-8961-4fc6-b7b1-76200f2e5c61</HostId>

Copy link
Copy Markdown
Member

@pwalczysko pwalczysko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please address the 2 comments above.

@wil-moore Is it maybe that the livingobjects bucket will become accessible later ?

Comment thread Cellpose_parallel.ipynb Outdated
"\n",
"Using ome-zarr for both IDR and BIA allows us to use the same analytical pipeline on data stored in two different resources.\n",
"We will run Cellpose against an [image](https://uk1s3.embassy.ebi.ac.uk/bia-integrator-data/pages/S-BIAD338/804b2976-1111-4099-8bfc-21d1d1d2163c.html) in BIA associated with the study with accession number [S-BIAD338]( https://www.ebi.ac.uk/biostudies/BioImages/studies/S-BIAD338)"
"We will run Cellpose against an [image](https://livingobjects.ebi.ac.uk/.ebi.ac.uk/bia-integrator-data/pages/S-BIAD338/804b2976-1111-4099-8bfc-21d1d1d2163c.html) in BIA associated with the study with accession number [S-BIAD338]( https://www.ebi.ac.uk/biostudies/BioImages/studies/S-BIAD338)"
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This one does not work either. Access denied.
Click on https://livingobjects.ebi.ac.uk/.ebi.ac.uk/bia-integrator-data/pages/S-BIAD338/804b2976-1111-4099-8bfc-21d1d1d2163c.html and observe

<Error>
<Code>AccessDenied</Code>
<Message>Access Denied.</Message>
<Key>
bia-integrator-data/pages/S-BIAD338/804b2976-1111-4099-8bfc-21d1d1d2163c.html
</Key>
<BucketName>.ebi.ac.uk</BucketName>
<Resource>
/.ebi.ac.uk/bia-integrator-data/pages/S-BIAD338/804b2976-1111-4099-8bfc-21d1d1d2163c.html
</Resource>
<RequestId>18A285AB176674EE</RequestId>
<HostId>54b010ed-8961-4fc6-b7b1-76200f2e5c61</HostId>
</Error>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

bia-integrator-data not migrated yet. BIA are doing that (hopefully).
Also duplicate .ebi.ac.uk/.ebi.ac.uk in url

Comment thread Cellpose_parallel.ipynb Outdated
@pwalczysko
Copy link
Copy Markdown
Member

Changes in Reading_zarr_images.ipynb are working fine. Note that Reading_zarr_images.ipynb does not use bia-integrator-data

@pwalczysko
Copy link
Copy Markdown
Member

In summary:

  1. bia-integration-data usage needs clarification
  2. typo in url - just accept Update endpoint #4 (comment) please

Co-authored-by: pwalczysko <p.walczysko@dundee.ac.uk>
@pwalczysko
Copy link
Copy Markdown
Member

In summary:

1. `bia-integration-data` usage needs clarification

2. typo in url - just accept [Update endpoint #4 (comment)](https://github.com/ome/EMBL-EBI-imaging-course-03-2026/pull/4#discussion_r3027448561) please

The Ad 1. above is fixed in #5

Copy link
Copy Markdown
Member

@pwalczysko pwalczysko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note the follow-up PR of #5

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants