AECVision is an object detection project for the construction industry. The main goal is to deliver good models for various problems like:

• Detection elements on plans to allow automatized tasks
• Speed up documentation analysis
• Create tools for future computer vision projects

Now project is base on YOLOv5 repo but in the future I will try other types of model architectures.

• Input image resolution 1280x1280
• Image file .jpg
• For tagging i use Label Studio
• Training model in Google Colab
• Detection images with using Sahi

modules # Project modules
├───object_detection # Detection screen module
│   └───screen_detection.ipynb 
├───prepare_data_and_training # Prepare data and training in google colab module
│   ├───dataset
│   │   ├───images
│   │   │   ├───test
│   │   │   ├───training
│   │   │   └───validation
│   │   └───labels
│   │       ├───labels_reduce_classes
│   │       ├───test
│   │       ├───training
│   │       └───validation
│   ├───prepare_data_from_pdf.ipynb
│   └───train_model_in_google_colab.ipynb
├───wall_detection_export # Export walls detection coordinates to csv and allow imports in other program
│   ├───files
│   │   ├───converted_pdf
│   │   ├───exported_csv
│   │   └───upload_pdf
│   ├───classes_functions.py
│   ├───wall_detection_export_with_sahi.py
│   └───wall_detection_export.py
train_results # Available modules
├───model_12classes
├───model_12classes_gray
├───model_walls
└───model_walls_gray
yolov5 # Cloned Yolov5 repository
LICENSE
README.md
requirements.txt

The model was trained on clear plans and with annotation but remember that the best results you get without many symbols on construction plans.

By using screen_detection.py

Press image to watch film. This works with my PYLAB extension

• Collect and tag more images (up to 500)
• Try to use Grayscale than RGB
• Change number of classes (maybe only 3? Wall, Window, Door)
• Evolve hyperparameters to get the best set (in YOLO)
• Use other model architecture (than YOLO)
• Think about switch from .jpg file to .png (avoid converting data lost)
• Think about how to add more "contexts" to the model (like: you are in the kitchen if there are stove and there probably will be table)

Walls are overrepresented because this is normal quantities in architectural plans.

Maybe in future, i need to create more plans with other categories to improve other classes detection.

• A small number of certain classes
• Conversion from pdf (default construction plans format) to jpg results in a loss of image quality

Contributions are always welcome! I look for help in tagging and improving models. Feel free to improve this project.

Thanks, YOLOv5 and Label Studio for your project and tutorials. Special thanks to my brother Marcin who help me with tagging.