Cotygodniowa dawka linków, czyli archiwum newslettera Dane i Analizy
How To Use “yield” in Python?
Python Generator — from basic to advanced usage Continue reading on Towards Data Science »
10 Best Practices to Write Readable and Maintainable SQL Code
How to write SQL queries that your team can easily read and maintain? It’s easy to mess with SQL without proper guidelines. Since everybody in your team might have their own habits of writing SQL, you can quickly end up with a confusing code that nobody understands. You probably realized the importance of following a set of good practices. May this article give you the guidance you’re (…)
How to Model Time Between Events Using the Exponential, Gamma, and Poisson Distributions
How to model time-to-event and ‘time between events’ on real data using the Exponential Family to optimize returns of time driven investments. Screenshots from within the article. Usually, when we have time as a variable on a dataset, we can model other variables reflected in time itself, whether we apply Time Series Analysis or just use time to cut our data and apply continual ML or S tate Space (…)
How to Create a PDF in Python. Utilizing PyFPDF, a library for PDF…
Utilizing PyFPDF, a library for PDF generation In this article, you’ll learn how to create your own customized PDF using a module called PyFPDF . According to the official documentation, PyFPDF is “… a library for PDF document generation under Python, ported from PHP (see FPDF : “Free”-PDF, a well-known PDFlib-extension replacement with many examples, scripts and derivatives). Compared with other (…)
I Analyzed 2k Data Scientist and Data Engineer Jobs and This is What I Found
Careers Leverage your Python Skills to Understand the Skills and Requirements of your Dream Job Motivation Have you ever wondered what the difference in the job requirements between data scientists and data engineers is? Instead of going through many job requirements to figure that out, why not use a tool to get descriptions of all data scientist and data engineer jobs at once? That is when (…)
Uncovering the Hidden Factors Driving Stock Prices
Wrangling through Dataland Dynamic factor modelling of US large-cap equities Picture by James Wainscoat from Unsplash M uch of what impels human behaviour is not directly observable . This is a common refrain in data analysis of social phenomenon, such as the socio-cultural drivers of education and income. Or in financial markets where many of the underlying factors that drive the buying or (…)
5 AWS Services Every Data Scientist Should Use
Image Source Amazon Web Services (AWS) provides a dizzying array of cloud services, from the well known Elastic Compute Cloud (EC2) and Simple Storage Service (S3) to platform as a service (PaaS) offerings covering almost every aspect of modern computing. Specifically, AWS provides a mature big data architecture with services covering the entire data processing pipeline — from ingestion through (…)
A Gentle Introduction To Gradient Descent Procedure
Gradient descent procedure is a method that holds paramount importance in machine learning. It is often used for minimizing error […] The post A Gentle Introduction To Gradient Descent Procedure appeared first on Machine Learning Mastery .
Mathematics Behind Principle Component Analysis In Statistics
ArticleVideo Book This article was published as a part of the Data Science Blogathon Introduction “Data is a precious thing and will last longer than … The post Mathematics Behind Principle Component Analysis In Statistics appeared first on Analytics Vidhya .
Run TensorFlow Models in the Browser
How to host a machine learning model serverless with TFJS and Amazon S3 Image generated by the author using wordclouds.com . Table of contents Introduction Train a digit recognition model with TensorFlow Host the model in S3 with TensorFlow.js Conclusion References Introduction Making a machine learning model available to your customers requires it to be accessible either through an Application (…)
Higher-Order Functions with Spark 3.1
Processing Arrays in Spark SQL. Complex data structures, such as arrays, structs, and maps are very common in big data processing, especially in Spark. The situation occurs each time we want to represent in one column more than a single value on each row, this can be a list of values in the case of array data type or a list of key-value pairs in the case of the map. The support for processing (…)
How to parallelize for loops in Python and Work with Shared Dictionaries
This article will cover the implementation of a for loop with multiprocessing and a for loop with multithreading. We will also make multiple requests and compare the speed. Sequential MultiProcessing MultiThreading Sharing Dictionary using Manager ‘Sharing’ Dictionary by combining Dictionaries at the end Comparing Performance of MultiProcessing, MultiThreading(making API requests) I have written (…)
4 pre-commit Plugins to Automate Code Reviewing and Formatting in Python
Write High-Quality Code with black, flake8, isort, and interrogate When committing your Python code to Git, you need to make sure your code: looks nice is organized conforms to the PEP 8 style guide includes docstrings However, it can be overwhelming to check all of these criteria before committing your code. Wouldn’t it be nice if you can automatically check and format your code every time you (…)
10 Best SQL Editor Tools in the Market
Find the best SQL editor that fits your use case Photo by luis gomes from Pexels In modern computing environments, diversified database platforms are the norm. Over the years, the demands of effectively using enterprise data resources have made it practically impossible for companies to standardize on a single database management solution. When data arrives in multiple formats, it simply cannot (…)
How to Watermark images using OpenCV
ArticleVideo Book This article was published as a part of the Data Science Blogathon Source In this article, we will learn how to watermark … The post How to Watermark images using OpenCV appeared first on Analytics Vidhya .
Three Popular Machine Learning Methods
Understanding the Basic Machine Learning Types As I’ve been diving deeper into the world of Data Science, there’s been a plethora of articles and tutorials on advanced Machine Learning topics. There is at least a large section of specifics and tutorials on how machine learning works and what libraries are best to use. However, I’ve noticed that there’s not much out there for those just starting (…)
Zestawienie linków przygotowuje automat, wybacz więc wszelkie dziwactwa ;-)