Understand the Big Data

Nowadays, we hear more and more about big data. For the majority of us, this term is vague, even if we know more or less what is behind that. 

Through this article, you will discover simple, precise and concise information about this subject.

Big Data’s history.

We began to talk about Big Data during the 60’s, 70’s, with the first data centre and the development of the relational database.

We needed to wait for 2005 to realize how much data users generated with websites like Facebook, or YouTube.

With the emergence of the Internet of Things (IoT), more objects are connected to the Internet, making it possible to collect data on customer usage patterns and product performance. 

Even if big data is not new, we can say that it is just its beginning. The big data possibilities continue to expand thanks to cloud computing.

Today, it is used in some sectors such as fintech, robotics, meteorology, medicine, environmental research, or informatics and cybersecurity.

What is Big Data?

According to Gartner « Big data is data that contains greater variety arriving in increasing volumes and with ever-higher velocity. This is known as the three Vs.»

When we talk about the three VS go big data, we talk about volume, velocity and variety. 

In recent years, two additional Vs have been added: value and veracity.

To make it easier: 

Volume: it represents the quantity of data;

Velocity: here we talk about the speed at which data is received and processed;

Variety: many types of data that are available, such as text, audio and video;

Value: this refers to the quality of the data;

Variety: this answer the question about the reliability of your data.

Types of Big Data.

1. Structured 

Here, we talk about all data that can be saved, process and display in a fixed format, like information stored in any database software; 

2. Unstructured 

Data with an unknown structure or format, like text, videos or images; 

3. Semi-structured 

It contains the two forms of data mentioned above. It is the case for XML files.

References:

‘What is Big Data’, oracle.com. Available at: https://www.oracle.com/ie/big-data/guide/what-is-big-data.html

Ray J., 2018. 'The Complete Beginner’s Guide To Big Data in 2018', Medium. Available at: https://medium.com/swlh/the-complete-beginners-guide-to-big-data-in-2018-82ed7a396ba3