Using Graph API & Pyspark to Move Sharepoint Files
We needed a background script running within our sharepoint directory that would read through a list of files and organize them according to their ids: creating a parent folder with the name of the id or loading the file into an existing id folder. Script:
Creating a Business Central Cloud & Bitbucket CICD Pipeline
In my bitbucket repository, I enabled pipelines and added branch restrictions for security purposes. Also I used Repository variables within in my bitbucket repository associated to my service principal set up in Azure app registration. This CICD pipeline allows my team to merge code to our main branch to auto-deploy-install our extension in our BC […]
Transitioning NAV on-prem to BC Cloud in 2025
This process has changed from 10 months ago. NAV on-prem needs to transition to BC14 on-prem to BC 25 on-prem to BC cloud. Pre-requisites: NAV on-prem to BC 14 transition: First follow to upgrade application code: https://learn.microsoft.com/en-us/dynamics365/business-central/dev-itpro/upgrade/upgrading-the-application-code to create application .txt files. Follow the steps here: https://learn.microsoft.com/en-us/dynamics365/business-central/dev-itpro/upgrade/upgrade-unmodified-application-v14-v25 Run the cloud migration setup in a new […]
Automated Jira Ticket Report Generation Per School Using Fabric & Power BI
It would be helpful for school admins or principals to see ticket activity per school per week. Seeing data like how many tickets in total, ticket number per user, tickets that were resolved vs opened would be helpful for admins to see. To do this, we should organize the data based on school first, so […]
Automating Custom Field Bulk Edits in Jira Post Migration with Fabric
We have automated around 100k tickets over to Jira and to clean the Jira production data, some fields need to be altered. By default, some tickets were assigned to Jin as a default user, but this is problematic for reporting and filtering purposes in the future. As such, we needed to change around 60k tickets […]
Real-time Most Recent Tickets (Solarwinds to Jira Service Management) Migration using Microsoft Fabric
I have two departments that I need to run this for: Facilities and IT. This initiative is being executed concurrently with UAT. Already over 150k tickets have been migrated over; however, to keep it testable for our users, we need to make sure old ticket system updates that are currently happening are somewhat replicated in […]
Automating Knowledge Base/ Documentation Transfer From Onenote to Confluence using Fabric
The general logic of executing the Onenote data ingest: Onenote data ingest PySpark code: import requests from pyspark.sql import SparkSession from pyspark.sql.types import StructType, StructField, StringType # Initialize Spark session spark = SparkSession.builder.appName(“OneNoteDataPipeline”).getOrCreate() # Authentication def get_access_token(): url = “https://login.microsoftonline.com/982d56ce-f6e7-4334-a1c4-5d6779c789a6/oauth2/v2.0/token” payload = { “grant_type”: “client_credentials”, […]
Leveraging PySpark to Automate Jira Ticket Creation
Trying to create a pyspark script in Microsoft Fabric to automate JIRA API ticket creation (post) calls against a lakehouse delta table. To do so, I have to educate myself on the pyspark syntax and framework. I will be doing so in this blog post. To reference a lakehouse delta table: Result: This was able […]
Automating Ticket Migration for Jira
I have been tasked with automating the migration of over 100k SolarWinds Helpdesk tickets over to Jira Service Management as we are preparing for the helpdesk transition. Plan: My current plan is to create an ETL on Microsoft Fabric that ingests CSV ticket data from Solarwinds and manipulate field values to fit our specific Jira […]
Microsoft Fabric & Spark SQL
The most common way to work with data in delta tables in Spark is to use Spark SQL. Lets say we have a table in OneLake called products: In the connected Spark SQL, we can insert data like so: When you want to work with delta files rather than catalog tables, it may be simpler […]