Azure Synapse 

ETL

Build Jar : Add multiple class files in the Jar using Bazel

 Add multiple class files in the Jar using Bazel 

Azure Synapse - Working with Custom jar Scala (Bazel)

 Working with Custom jar in Azure 

There is 2 Jars :

1. Big Fat Jar or uber Jar (Contains main class  )
2. Build Dependency Jar/ Library to be used in Synapse 

Big Fat Jar or uber Jar:

• Contains main class
• Contains all the Dependency
• Contains manifest File
• $ bazel build build_name_deploy.jar
• Can be run as : build_name_deploy.jar
• Eg: https://github.com/j-thepac/BazelTestProject
• Ref - https://docs.bazel.build/versions/main/be/java.html

Build Dependency Jar/ Library

• Does not Contain main class
• Does not contain dependencies
• Note : Download external dependencies from Maven and upload it separately (refer bewlo link)
• $ bazel build build_name.jar

Once u have jars Created based on ure need , use link - https://docs.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-manage-scala-packages to upload to Azure 

Azure Synapse : Passing and receiving Values to and from Notebooks

 Passing and receiving Values to and from Notebooks

SQL : Index

Index

Scala : HTTP Client using Sttp

 HTTP Client using Sttp

 Coding Principles

Azure Django-postgres Application

 Azure Errors and Solution

Azure Linux VM

Azure Linux VM Connection

pre-Req: 

1. For Mac Users
2. Make sure linux machine is created

Steps:

1. Open Linux Machine Panel
2. Go to Settings > Connect > SSH
3. Click on other Clients
4. From the new page opened , Copy Create an SSH key Pair "ssh-keygen -m PEM -t rsa -b 4096"
5. Run "ssh-keygen -m PEM -t rsa -b 4096" in Terminal
6. Click Enter all the times

Testing Connection

1. In the previous page , enter the path of the id_rsa.pub Eg : "~/.ssh/id_rsa.pub" or "(if u have added the file in a new folder ) ~/.ssh/vm_linux/pushpa/id_rsa.pub " 
2. click on "test your connection"
3. Your unsaved edits will be discarded , ck Yes
4. Ck on Test Connection 
5. this shd pass

Connection:

1. Settings > Connect > SSH 
2. copy the run example ie ., ssh -i <private key path> pushpaxxxxx@1xx.xx.1xx.xx
3. Replace the privae key path to ids_rsa which was created
4. Make sure u give the azure account password when asked

Install Python3

1. sudo su
2. <azure password>
3. yum install python3
4. pip3 install requests

 Azure Static WebPage

Azure API

 Azure Cosmos DB