Technological Requirements of Big Data

Technological Requirements of Big Data

I found an article explaining the requirements of Big Data to be collected at an exponential rate in today's world. 

https://www.linkedin.com/pulse/technological-requirements-big-data-mustafa-sultani?trk=pulse-article_more-articles_related-content-card

The technological requirements of Big Data are:

  • Storage 
  • Processing
  • Data Integration 

Storage

The falling cost and rising capacity of digital storage have been made possible by the cloud. This allows for huge amounts of data to be stored on server farms. These cloud services should limit the chance of data being lost due to disk or system failure.

Processing

Improved computer power has made it possible for more powerful software to analyse huge data sets. This powerful software, such as Hadoop and Spark, can be used for analysing, processing and extracting data from an extremely complex data set.

Data Integration

Big Data integration is now a practice in all large organisations. It is the requirement to combine data from multiple separate business systems into a single unified view, called a single view of the truth. This unified view is typically stored in a central data repository known as a data warehouse.

I read that data integration also has challenges, such as data always changing, therefore, trends must be managed and assessed for integrity to ensure the data received is relevant and still valuable to companies so they can make the right decisions.


Comments

Post a Comment

Popular posts from this blog

Limitations of Traditional Statistics

Image
 Limitations of Traditional Statistics In my last post, I spoke about the use of traditional statistics. Now, I will cover some of the drawbacks of using traditional statistics to make predictions in the real world. Traditional data analysis has been practised with structured data, often in a relational database; however, Big Data isn’t as manageable with this structured format. Traditional statistics is about analysing and summarising data and is suited to processing smaller amounts of linear, repeatable data to draw a conclusion. The easiest environments are when the data has a stable relationship – e.g. regular exercise increases, obesity decreases. Therefore, the practicality of traditional data analysis is limited when applied to the real world. More recently, there is now the availability of new large data sets and cheaper and faster computing power. In addition, there has been a surge in machine learning research and development, which aims to automatically discover re...
Read more

Traditional Statistics

 Traditional Statistics Today we learned about types of traditional statistics and how they're used to draw conclusions.  Statistics is the discipline that concerns the collection, organisation, analysis, interpretation, and presentation of data. It can be broken up into descriptive and inferential statistics. Descriptive Statistics Only the subjects that have been analysed have findings implied upon them. If we had the political views of 20 people, we may be interested in the voting intentions of these people or the distribution or spread of the votes, but the findings are limited to only these 20 people. Inferential Statistics If you don’t have access to the whole population you’re interested in, but only a small portion. If you want to study the political voting intentions of everybody in Scotland. From what I've learnt about the two types, I would say that descriptive is more accurate as conclusions are drawn from what the data had been directly collected from. Howev...
Read more

Growth of Big Data

Image
 Growth of Big Data We covered the growth of data throughout the modern era. It is fascinating how much the growth of data is accelerating and the comparison of the technology used to store or analyse that data only 5 or 10 years earlier. In 2011, the entire world created around 1.8 zettabytes. This is equivalent to 1.8 billion terabytes. By 2020 it was estimated to be 30 times that amount.   Today, Facebook has 2.2 billion monthly active users. This is because of the accessibility of mobile smart devices to the average person. In 2005, a Facebook user would likely have to use their home computer to use the site, however, now it can be accessed essentially anywhere at any time from a mobile phone.
Read more