Generate and Extend your Custom Dataset [Script]

About

As you know, it really requires a lot of data, especially, accurate data in order to also achieve a successful model at the end of the training process. Considering sometimes data, which is completely custom and really hard to find high quality ones on the internet, this script is going to increase your current data size by a few times with different methods of image manipulation to give you a much more accurate and stable model at the end.

Custom Input Data

Based on your current available data, this simple script will go over, and extend your current dataset by using image manipulation methods as following:

  • Blurred
  • Black and White
  • Noisy
  • Flip (over X, Y, Center)
  • Bright
  • Hue
  • More to come…

Requirements

numpy
opencv-python
scikit-image
random

Run the script

Windows $python main.py

Linux & MacOS$python3 main.py

Folder Structure

Generate-Datset

└── BlackAndWhite
│ └── __init__.py

└── Blur
│ └── __init__.py

└── Brightness
│ └── __init__.py

└── Flip
│ └── __init__.py

└── Hue
│ └── __init__.py

└── Noise
│ └── __init__.py

└── Shear
│ └── __init__.py

└── main.py


└── README.md

└── src
└── input
│ └── image1.jpg
│ │
│ └── image2.jpg
│ │
│ └── image3.jpg
│ │
│ └── image4.jpg
│ │
│ └── image5.jpg
└── output

Features to come

Current version of the script allows the users to prepare their data before annotating them. However, in the next version, script will also be ready to be easily used by the users on a ready to train data, where the script itself will also generate the label data of the given inputs by itself automatically, letting user only spend a few seconds on the generation, and then directly set on training.

New image manipulation methods to increase the data as much as we can and more!

Reference

https://github.com/woosal1337/Generate-Dataset

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store