mltrace | grained lineage and tracing for machine learning pipelines | MLOps library

Please i need you help concerning my yolov5 training process for object detection!

I try to train my object detection model yolov5 for detecting small object ( scratch). For labelling my images i used roboflow, where i applied some data augmentation and some pre-processing that roboflow offers as a services. when i finish the pre-processing step and the data augmentation roboflow gives the choice for different output format, in my case it is yolov5 pytorch, and roboflow does everything for me splitting the data into training validation and test. Hence, Everything was set up as it should be for my data preparation and i got at the end the folder with data.yaml and the images with its labels, in data.yaml i put the path of my training and validation sets as i saw in the GitHub tutorial for yolov5. I followed the steps very carefully tought.

The problem is when the training start i get nan in the obj and box column as you can see in the picture bellow, that i don't know the reason why, can someone relate to that or give me any clue to find the solution please, it's my first project in computer vision.

This is what i get when the training process starts

This the last message error when the training finish

I think the problem comes maybe from here but i don't know how to fix it, i used the code of yolov5 team as it's in the tuto

The training continue without any problem but the map and precision remains 0 all the process !!

Ps : Here is the link of tuto i followed : https://github.com/ultralytics/yolov5/wiki/Train-Custom-Data

I have written my code to create a scatter plot with a color bar on the right. But the color bar does not look right, in the sense that the color is too light to be mapped to the actual color used in the plot. I am not sure what is missing or wrong here. But I am hoping to get something similar to what's shown here: https://medium.com/@juliansteam/what-bert-topic-modelling-reveal-about-the-2021-unrest-in-south-africa-d0d15629a9b4 (about in the middle of the page)

When importing a .csv file, is there any way to read the data from the title of the header? Consider the .csv file in the following:

I mean, instead of start_node = round.(Int64, data[:,1]) is there another way to say "start_node" is the one in the .csv file that its header is "start node i"

I'm trying to implement a simple GAN in Pytorch. The following training code works:

I am looking for a similar functionality like Fillo Excel API where we can do CRUD operations in an excel file using query like statements.

A select statement in a csv file is a great addition to the framework to provide more flexibility in test data driven approach testing.

Sample scenario: A test case that needs to have multiple data preparation of inserting records to database.

Instead of putting all test data in 1 row or 1 cell like this and do a string split before processing.

I have a python script that handles data transactions through sqlalchemy using:

I am trying to use GridSearchCV to select the best imputer strategy but I am having trouble doing that.

First, I have a data preparation pipeline for numerical and categorical columns-

I'm training a model within a for loop, because...I can. I know there are alternative like tf.Dataset API with generators to stream data from disk, but my question is on the specific case of a loop.

Does TF re-initialize weights of the model at the beginning of each loop ? Or does the initialization only occurs the first time the model is instantiated ?

EDIT :

I have 2 tests. I want to run the only one: