Fuli Vision · Technology

On NVIDIA RTX 4090 today. On Jetson in the store next.

We already test and run vision models on an NVIDIA RTX 4090 with CUDA at Universiti Malaya, through a research collaboration. Next: NVIDIA TAO Toolkit for transfer learning on local produce, then in-store inference on NVIDIA Jetson with TensorRT and DeepStream, so each store works without a cloud round-trip.

NVIDIA RTX 4090CUDAPyTorchNVIDIA TAO ToolkitTensorRTNVIDIA JetsonDeepStream
Pipeline

Five stages. GPU where the work is seeing.

CPU where the work is plumbing: cameras, confirmations, reports. GPU where the work is recognising, grading and watching many shelves at once.

CaptureScale and shelf cameras. Fixed, downward, store-owned.CPU
LabelStaff confirmations at the scale and buyer grades at receiving are the labels.CPU
Test and runPyTorch models tested and run on an NVIDIA RTX 4090 with CUDA at Universiti Malaya. Next: NVIDIA TAO Toolkit for transfer learning on local produce.■ GPU · today
OptimiseTensorRT engines per device, INT8 or FP16, so the store model fits a small box.■ GPU · next
RunNVIDIA Jetson at the scale; DeepStream for several shelf cameras on one device. Works offline.■ GPU · next
How it learns

A loop that runs inside the store.

Public produce datasets plus the first weeks of store photos to start. Then every confirmation at the scale makes the next model better, store by store.

CaptureCamera at the scale photographs each item as it is weighed.
ConfirmStaff tap to confirm or correct. Low-confidence items default to the manual flow.
TrainModels retrained on confirmed store images, on NVIDIA GPUs.
DeployEach store's model is pushed to its own device at the scale.
CorrectMisses flow back as training data. The loop repeats.
Per-store models

Each store's lighting, scale and assortment get their own adaptation, pushed to that store's device. A new store starts from the shared model and diverges from day one.

Human in the loop, by design

The model proposes; a person confirms. Nothing is charged or marked down without a tap. Low confidence means the normal manual flow, not a guess.

Cold start without cloud

Public datasets cover the common items; local varieties will come from the founder's two stores. The first external store never sends a single image to a cloud to get started.

How we measure

Numbers we will publish, per produce type.

Measured in the founder's two stores before any external store. We publish accuracy by produce type, not one headline figure, because a model that is excellent on bananas and poor on sawi is poor.

ModuleMetricHow it is measuredReported
ScaleTop-1 accuracy by produce typeModel's first proposal against the staff confirmation, per item, per storePer produce type, per store, monthly
ScaleFirst-tap confirmation rateShare of weighings confirmed without a changePer store, weekly
ScaleManual fallback rateShare of weighings below the confidence thresholdPer store, weekly
GradeAgreement with the buyerModel grade against the store buyer's grade on the same lot and photoPer produce type
GradeMarkdown timingLots marked down on the suggested time, and whether they sold before closePer store, weekly
ShelfEmpty-slot precision and recallAlerts against a staff walk-through at fixed timesPer display
ReceivingWeight variance caughtLines flagged against lines later disputedPer supplier
Privacy by design

Cameras at produce, not people.

Pointed at the pan and the shelf

Fixed cameras look down at the scale pan and across the display. Faces are not what the models look for, and there is no customer tracking of any kind.

Images stay in Malaysia

Store images are stored and processed in Malaysia. Recognition at the scale runs on the in-store device, without a cloud round-trip.

Staff own the labels

The training signal is the staff's own confirmation, not a third-party dataset. Stores can see and delete their images.

Compute in country

Compute stays on NVIDIA GPUs in Malaysia.

Today models are tested and run on an NVIDIA RTX 4090 at Universiti Malaya. Next, training on local produce will run on NVIDIA data-centre GPUs available in Malaysia, with the same rule: store images do not leave the country.

The in-store device runs inference only; training never happens on the shop floor.

A pile of green and red bird's eye chillies