Skip to main content

Jump Start with Azure Databricks - Chapter 4: How to Get Started to Work with Data

Azure Databricks is the latest and greatest way of processing Big Data in Azure cloud. It is an apache spark based analytics platform allow users to setup spark clusters with few clicks, streamlined workflows, collaborate with data engineers and data scientists. I’ve started to write a series of to demonstrate step-by-step how to engage with Azure Databricks. As this my fourth article, I've explained How to Getting Started to Work with Data. If you are new to Azure Databricks, I recommend you to going through my first: How to create Azure Databricks Workspace and How to Create Spark Cluster in Databricks article before reading this.


Article 3: How to Create a Spark Cluster


https://social.technet.microsoft.com/wiki/contents/articles/52812.azure-databricks-how-to-get-started-to-work-with-data.aspx

Summary

This is the 4th article of my article series Jump Start with Azure Databricks. In this tutorial, I’ve explained how to upload data into Azure Databricks. Then moved to create a Notebook and import the uploaded data and created a table. Later in this article, I’ve done some queries to analyze the dataset. Hope this helped you to get started to work with Databricks. 
Labels:

Comments

  1. ZachApril 29, 2019 at 11:27 AM

    Hi Nishal, your link in this article is for Chapter 3 - create spark cluster. Can you update it to the new, Chapter 4 article?

    ReplyDelete
    Replies
    1. NisalApril 29, 2019 at 11:50 AM

      Thank you Sir!.. I corrected it and changed to the correct URL. Thanks again :-)

      Delete
  2. Micheal AlexanderAugust 4, 2020 at 1:45 PM

    This is a really informative knowledge, Thanks for posting this informative Information. Curso Azure Databricks

    ReplyDelete

Post a Comment

Popular posts from this blog

Step-by-Step Twitter Sentiment Analysis Using Power BI Streaming Dataset, Microsoft Flow and Azure Text API

Sentiment Analysis is known as Opinion mining or emotion AI which is a branch of Natural Language Processing and text analytics where systematically identify, extract, quantify, and study affective states and subjective information. This kind a analysis widely apply to analyse the product or service reviews, voice of the customer, survey responses from online and social media feeds to analyze the attitude of the customer. Basically from the sentiment analysis the output would be either Positive, Negative or Neutral.  There are various algorithms and methods to do a sentiment analysis out there. In this post here I'm doing a sentiment analysis for iPhone 8 product by analyzing twitter feeds. Because, I wanted to know what others are thinking about the latest phone released by Apple. In order to do this task I'm using,  Microsoft Azure cognitive services : Text Analytics (to run the sentiment analysis algorithms to get out the results)  Microsoft Flow ...
5 comments
Read more

How to Get Row Counts for all Tables in your SQL Database

This is the simplest method to get the row counts of all tables in your SQL Server database. Might be useful when you are doing the data testing over your BI project.     select   schema_name (tab.schema_id) , tab.name  as  [table],         sum (part.rows)  as  [rows]     from  sys.tables  as  tab          inner join  sys.partitions  as  part              on  tab.object_id  =  part.object_id where  part.index_id  IN  ( 1 ,  0 )  //   0 :  Table   without  PK,  1 :  table   with  PK and   schema_name (tab.schema_id)  =   'dbo'   group by   schema_name (tab.schema_id) , tab.name --order by sum(part.rows) desc  
Post a Comment
Read more

COVID-19 Situation in Sri Lanka: Real-time Dashboard using Power BI

[Updated on March 28, 2020] COVID-19  is a new strain that was discovered in late December, 2019 and by now it has been started to spread all over the world including 199 countries. There are around 26,000 people were died due to the virus and 580,000 confirmed cases at the moment I update this blog post. Though, the fatality rate is lower when compared to other viruses in similar strains like MERS and SARS . However, the biggest challenge most of the countries facing right now is to accommodate the patients with the growing numbers at every minute. The public was asked by the government to avoid nonessential gatherings as much as possible to stop spreading this deadly virus. Even though there were not many cases found in Sri Lanka, from March first week, they found the initial case a patient who works as a tourist. Now the situation is turning to worst after they found many cases especially tourists who are born Sri Lankans came down from Italy and European countries....
4 comments
Read more