Gianpaolo Macario's blog

ARNEIS project journal - dev-cw04

As I announced in a previous post

Your team “B-AROL-O Bottling Systems” and project “ARNEIS: Automated Recognizer, Network-Enabled, Items Sorter” have been selected as one of just 50 teams to move on to Phase 2 of OpenCV Spatial AI Contest. Your team name and region are listed on the official webpage at https://opencv.org/opencv-spatial-ai-contest/​

Here is the report of our progress in the ARNEIS project after the end of CW04-2022.

What did we accomplish this week?

In Sprint dev-cw04 we closed 21 issues or Pull Requests

Let's highlight some of the most relevant things which happened.

First rendering of the ARNEIS Bottle Conveyor

Well, we had already anticipated this with a teaser in our previous weekly post and in a tweet, anyway here is the actual result that Alessandro achieved so far:

Bottle conveyor 2022-01-22

(Watch the video on YouTube)

You can check the details, including the LDraw file, directly inside ARNEIS git repository.

Problems in sourcing LEGO Set 42100

When in mid December the ARNEIS project was selected as a finalist for the OpenCV Spatial AI Contest, we promptly submitted the request for LEGO Set 42100 (Liebherr R 9800 Excavator) which at that time was available from a few local resellers - one of which even offered a 41% discount on its list price.

image

Later we were communicated that the requested sets should be purchased and delivered to us directly by the OpenCV Spatial AI Contest organization, threfore we could not get the 41% rebate on the chosen set.

Unfortunately a couple of days ago Phil Nelson from OpenCV wrote us that

I’ve been trying to track this down online for awhile, it appears the Liebherr R 9800 Excavator set is retired by LEGO.

This is bad news, since we have based all our design and planning of the ARNEIS project under the assumption that we would receive this LEGO Set ASAP.

At the moment there are still a few items left from a couple of vendors on Amazon.it:

image

and eBay.it

image

but their prices are increasing - most likely because the set is no longer produced - so we need to hurry up.

By the way, at the moment we are not aware of alternate LEGO sets containing so many useful pieces for our design, such as motors, controllers, gears, etc. There have been some rumours of a replacement set but most likely this will be released in Q3-2022, so this does not fit within the Phase 2 time frame.

We have a constant conversation with Phil and the OpenCV organization in order to have this issue resolved; if you have any suggestions, please follow-up on ARNEIS/issues/7.

First attempts at recognizing mignon bottles with the OAK-D-Lite

Gianluca Teti - the wannabe AI expert in our team - has been playing with the OAK-D-Lite software for the purpose of recognizing the mignon bottles that will be handled by the ARNEIS system.

He already got some results:

image

The actual photo shoot took place using this stage:

photo1642596731

Here are some more details about the stage:

photo1642596718

In the coming days we will be optimizing the lighting and will update the camera setup to match the actual layout of the ARNEIS conveyor. You may see some preliminary studies here. As soon as we finalize the layout, we will be start training a customized Neural Network to recognize the bottle types we will be classifying.

Next week plans

Our plan for next week is available on GitHub: https://github.com/B-AROL-O/ARNEIS/milestone/3.

If you want to help or just say hello, please get in touch with us through GitHub or Twitter.

Thanks for reading up to here!

Gianpaolo on behalf of the B-AROL-O Team.