For the second article in the .NET for Apache Spark series, we’ll be looking into how to interact with Azure Data Lake Storage Gen1. We’ll be creating a DataFrame, writing the DataFrame into a Data Lake and retrieving the written data back into our application. Prerequisites # To get started: You’ll need an Azure Data Lake Storage Gen 1 account. Download and install .NET Core 3. ...
In this article, we’ll look into how to create a DataFrame, write the DataFrame into Azure Blob Storage, and read the written data back into our application. Prerequisites # To get started: You’ll need Azure Storage account. Complete .NET for Apache Spark Tutorial - Get started in 10 minutes. This guide will show you how to download and install .NET Core 3.1 SDK, JDK 8 and Apache Spark 2. ...
In the last article, I talked about how to deploy a Hugo static site to Azure storage and CDN using GitHub Actions. Setting up that pipeline however had many steps, and could perhaps be considered a bit abstruse. With the advent of the new Static Web App service, Microsoft has now significantly simplified the same solution. Within a few clicks on Azure Portal, your web app (in a GitHub repository) can be automatically configured for CI/CD via GitHub Actions and published to Azure. ...
You may have noticed the impressive speed at which this website loads. This is because it was built using a static site generator (Hugo) and deployed to Azure (Blob) Storage, with caching enabled via Azure CDN. This deployment configuration allows us to enjoy one of the cheapest solutions, with an estimated cost of £1 per month for storage and CDN. Right, to the main topic: GitHub Actions # GitHub Actions provides the flexibility to setup a CI/CD workflow, allowing us to automate our build, test and deployment pipelines. ...
Welcome to dynamicdev.io # Over the course of the next few months, we’ll be publishing some of the most interesting articles on Software Development, Cloud Development, Data Engineering and much more. Content will be centered around on Microsoft technology stack, however we’ll also cover other awesome products and technologies. Add a bookmark and subscribe to be notified when we release new content. For now, toggle dark mode, relax and we’ll see you in a bit. ...