索尼·什雷斯塔，尼泊尔中部开发区巴克塔普尔的开发者
Sony is available for hire
Hire Sony

Sony Shrestha

Verified Expert  in Engineering

Database Developer

Location
Bhaktapur, Central Development Region, Nepal
Toptal Member Since
March 22, 2022

索尼是一位可靠的软件工程师，有三年多的数据库开发经验, primarily focusing on databases. 她目前在一家数据分析公司工作，每小时处理数百万笔交易. Most of Sony's work consists of back-end architecture designing, ETL processes, performance tuning, Pentaho job optimization, designing interactive dashboards, creating data pipelines, analyzing complex datasets, and mentoring interns and trainees.

Data MigrationData EngineeringMySQLPostgreSQLETLMicrosoft SQL ServerSQLDatabasesDatabase DesignMicrosoft Power BIMicrosoft ExcelData CleansingApache AirflowOraclePythonMicrosoft AccessApache ClickPentaho

Portfolio

Verisk Nepal Pvt. Ltd.
Pentaho, JasperReports, Python, PostgreSQL, Amazon Web Services (AWS)...
Toptal Client
SQL, Amazon Athena, Amazon S3 (AWS S3)， Python，抓取，Spotify API...
ExtensoData
Pentaho, MySQL, PostgreSQL, Oracle, Python, Apache Airflow...

Experience

Apache Airflow - 3 yearsPostgreSQL - 3 yearsMicrosoft SQL Server - 3 yearsMicrosoft Power BI - 3 yearsSQL - 3 yearsPentaho - 3 yearsETL - 3 yearsPython - 2 years

Availability

Part-time

Preferred Environment

Windows, Visual Studio Code (VS Code), Git

The most amazing...

...project I've worked on is Foneloan, 银行通过手机银行应用程序向就业人员提供短期贷款的服务.

Work Experience

Software Engineer

2021 - PRESENT
Verisk Nepal Pvt. Ltd.
  • 优化了Pentaho工作和转换，减少了83%的处理时间.
  • Migrated the legacy data from Microsoft SQL Server to PostgreSQL.
  • Implemented data masking techniques, such as pseudonymization, anonymization, encryption, redaction, shuffling, 并争先恐后地确保个人身份信息(PII)的数据治理.
  • 评估了每天处理超过5tb数据的数据管道的工作流程和提高的效率.
  • Created interactive dashboards using Power BI, 利用度量和DAX向业务团队提供有意义的见解.
  • 确定生产中出现的技术错误的根本原因，并在ETL中进行必要的更改以修复它们.
  • 审查其他开发人员为A-PLUS Property开发的源代码.
  • Designed data models, created schemas and tables, wrote stored procedures, and fine-tuned SQL, reducing processing time by more than 50%.
  • 为业务团队开发KPI仪表板，以查看客户提交的详细信息，并立即确定关键因素.
  • 使用JasperReports编写A-PLUS Property的业务报告.
Technologies: Pentaho, JasperReports, Python, PostgreSQL, Amazon Web Services (AWS), Amazon Aurora, Microsoft SQL Server, Data Cleansing, Data Cleaning, Data Migration, Snowpipe, Microsoft Access, Microsoft Excel, Microsoft Power BI, MySQL

Data Engineer

2022 - 2022
Toptal Client
  • Prepared a Python script for scraping data from Soundchart, Chartmetric, 和Spotify从音乐行业的应用程序的几个api中收集与音乐相关的数据.
  • 在将数据从原始数据库迁移到干净数据库时准备复杂的SQL脚本.
  • 使用Terraform(基础设施即代码)在AWS上配置、更改和改进资源.
  • Prepared AWS Glue Crawler that uses a custom classifier, 使其能够识别AWS S3中可用的各种数据的模式.
Technologies: SQL, Amazon Athena, Amazon S3 (AWS S3)， Python，抓取，Spotify API, Object-oriented Programming (OOP), Apache Airflow, Terraform

Data Engineer

2021 - 2021
ExtensoData
  • 准备了一个ETL管道，用于使用Pentaho跨10个主数据源摄取事务数据.
  • Pentaho数据集成(PDI)中准备好的作业和转换, starting from extracting data from the source, performing necessary modifications for calculating facts, 并将相关信息加载到最终报表中.
  • 组装一个从失败步骤重新开始执行的ETL作业, 防止重新处理在先前执行中成功的步骤的必要性.
  • 实现了一种逐级记录机制来跟踪元数据步骤.e., when the job started, failed, or succeeded.
  • Generated dummy data for 25 tables in master and raw databases, using the Faker module in Python and Pentaho.
  • 使用Apache Airflow编写用于调度和监控ETL管道的DAG.
  • Deployed Foneloan as a product in four different Nepalese banks.
  • 指导实习生了解ETL流程和Pentaho.
  • 使用Microsoft Access创建关系数据表，设计表单和各种报表，以满足管理需求.
Technologies: Pentaho, MySQL, PostgreSQL, Oracle, Python, Apache Airflow, Microsoft SQL Server, Databases, Database Design, Data Migration, Data Cleaning, Data Cleansing, Data Engineering, Microsoft Power BI

Associate Data Engineer

2019 - 2021
ExtensoData
  • 评估Foneloan的现有架构，并设计新的架构，以满足多个客户端的不同需求，同时保持ETL流的通用性.
  • 自动化ETL过程，消除了手动编码来管理数据流的必要性.
  • 使用Pentaho数据集成(PDI)执行数据清理和验证.
  • 优化了SQL查询，减少了50%以上的处理时间.
  • Increased the efficiency of data fetching by approximately 30%, using query optimization and indexing.
  • Ingested data from disparate data sources like SQL, MySQL, Oracle, and CSV to create data views for business intelligence tools.
  • 测试名为Budget的项目的端到端流程，提出bug，并提供建议.
  • 使用Python执行网页抓取以生成不同航空公司的时间表.
  • 通过设计和开发BI报告并提供宝贵的见解，将整体决策提高了30%.
Technologies: MySQL, Oracle, Pentaho, Apache Kafka, Python, Git, ETL, Microsoft SQL Server, Databases, Database Design, Data Migration, Data Cleaning, Data Engineering, Microsoft Power BI

Data Trainee

2019 - 2019
Extensodata, F1Soft
  • 组织查询，包括合并操作和窗口函数.
  • Assembled stored procedures for performing repetitive queries.
  • 准备触发器来跟踪所执行的插入、删除和更新操作.
  • 研究了处理个人身份信息的不同方法.
  • Built database structures containing different constraints.
Technologies: Agile Practices, Databases, MySQL, SQL, Microsoft Power BI, Python, Pentaho, Data Engineering

Foneloan

http://foneloan.com.np/
Foneloan是一项由银行提供的数字贷款服务，通过手机银行应用程序向就业人员即时提供小额短期贷款. 根据银行设定的标准，自动分析系统认为符合条件的银行客户可以获得这些预先批准的贷款.

Esewa

http://esewa.com.np/
Esewa是一个位于尼泊尔的数字钱包，提供即时在线支付解决方案. 这个支付网关是尼泊尔第一个安全简便的在线支付方式，无需向商家暴露信用卡号码和银行账号.

A-PLUS Property

汽车财产损失承保服务(A-PLUS)财产收集和报告与房屋相关的保险索赔和损失历史, auto, or personal property. 它为公司提供了一种必要的格式来报告财产和责任索赔，然后将其纳入a - plus数据库.

Languages

SQL, Python, Snowflake

Tools

Microsoft Power BI, Microsoft Excel, Apache Airflow, Microsoft Access, Amazon Athena, Git, Shell, Terraform, AWS Glue, AWS Batch

Paradigms

ETL, Database Design, Object-oriented Programming (OOP)

Platforms

Pentaho, Oracle, Windows, Amazon Web Services (AWS), Visual Studio Code (VS Code), Apache Kafka, Amazon EC2

Storage

MySQL, PostgreSQL, Microsoft SQL Server, Databases, Amazon Aurora, SQL Server Integration Services (SSIS), Amazon S3 (AWS S3)

Other

Data Migration, Data Engineering, DataFrames, Data Cleaning, Data Cleansing, Agile Practices, Snowpipe, Scraping, Data Analytics, Personally Identifiable Information (PII), Amazon RDS

Frameworks

ASP.NET MVC

Libraries/APIs

JasperReports, Spotify API

2015 - 2019

Bachelor's Degree in Computer Engineering

KL University - Vijayawada, India

FEBRUARY 2022 - PRESENT

AWS Solutions Architect Associate

AWS

NOVEMBER 2021 - PRESENT

AWS Certified Cloud Practitioner

AWS

Collaboration That Works

How to Work with Toptal

在数小时内，而不是数周或数月，我们的网络将为您直接匹配全球行业专家.

1

Share your needs

在与Toptal领域专家的电话中讨论您的需求并细化您的范围.
2

Choose your talent

在24小时内获得专业匹配人才的简短列表，以进行审查，面试和选择.
3

Start your risk-free talent trial

与你选择的人才一起工作，试用最多两周. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring