Oracle python pandas merge DataFrames
Download as pptx, pdf1 like702 views
This document provides a tutorial on merging two dataframes using the Python library Pandas, as part of a wider workshop. It outlines the steps to load datasets from CSV files and merge them using specified keys. The intended use of the code is for educational purposes only and should not be used in production applications.
1 of 8
Download to read offline
![Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 5
import pandas as pd
df0 = pd.read_csv('../../data/dataset_4.csv', delimiter=";",)
print ('show the content of the first file via dataframe df0')
print (df0.head())
df1 = pd.read_csv('../../data/dataset_5.csv', delimiter=";",)
print ('show the content of the second file via dataframe df1')
print (df1.head())
df2 = pd.merge(df0, df1, on=['Country Code','Country Name'])
print ('show the content of merged dataframes as a single dataframe')
print (df2.head())
Python Development
Pandas – merge DataFrame
Read first
CSV file
Read second
CSV file
Merge
DataFrames
Show me the code
1) Please note the 3 steps in the above code (two times read_csv() and one merge()
2) Find example at : https://github.com/louwersj/examples_machineLearning/blob/master/pandas/merging/pd_merge_example_1.py](https://image.slidesharecdn.com/oraclepythonpandasmergedataframesv01-190220132355/85/Oracle-python-pandas-merge-DataFrames-5-320.jpg)
Ad
Recommended
Clustering
ClusteringRashmi Bhat This document provides information about clustering and cluster analysis. It begins by defining clustering as the process of grouping objects into classes of similar objects. It then discusses what a cluster is and different types of clustering techniques, including partitioning methods like k-means clustering. K-means clustering is explained as an algorithm that assigns objects to clusters based on minimizing distance between objects and cluster centers, then updating the cluster centers. Examples are provided to demonstrate how k-means clustering works on a sample dataset.
Classification techniques in data mining
Classification techniques in data miningKamal Acharya The document discusses classification algorithms in machine learning. It provides an overview of various classification algorithms including decision tree classifiers, rule-based classifiers, nearest neighbor classifiers, Bayesian classifiers, and artificial neural network classifiers. It then describes the supervised learning process for classification, which involves using a training set to construct a classification model and then applying the model to a test set to classify new data. Finally, it provides a detailed example of how a decision tree classifier is constructed from a training dataset and how it can be used to classify data in the test set.
Latent Dirichlet Allocation
Latent Dirichlet AllocationSangwoo Mo This document provides an overview of Latent Dirichlet Allocation (LDA), a generative probabilistic model for collections of discrete data such as text corpora. It defines key terminology for LDA including documents, words, topics, and distributions. The document then explains LDA's graphical model and generative process, which represents documents as mixtures over latent topics and generates words probabilistically from topics. Variational inference is introduced as an approach for approximating the intractable posterior distribution over topics and learning model parameters.
Multi media Data mining
Multi media Data mininghome Data mining involves automatically extracting knowledge from large data sets. For multimedia data like images, video and audio, data mining techniques are used to discover relationships between objects. Image mining techniques include object recognition, image retrieval, image indexing, image classification and clustering, and association rule mining. Image mining is used in applications like military reconnaissance, weather forecasting, criminal investigations and medical imaging.
Principal Component Analysis
Principal Component AnalysisRicardo Wendell Rodrigues da Silveira The document discusses Principal Component Analysis (PCA) as a feature engineering technique aimed at reducing dimensionality while preserving data variability. It highlights the challenges posed by high-dimensional data and how PCA helps in identifying correlations among variables to enhance classification tasks. The document also outlines the steps to perform PCA and emphasizes its utility in agile analytics for improving feature selection and extraction.
CLUSTER ANALYSIS ALGORITHMS.pptx
CLUSTER ANALYSIS ALGORITHMS.pptxShwetapadmaBabu1 The document discusses various clustering algorithms used in data analysis, explaining the concept of clustering as grouping similar data points. It covers different types of clustering, including hard and soft clustering, as well as methods like k-means, k-medoids, BIRCH, and DBSCAN, detailing their mechanics and advantages. The document concludes by categorizing clustering algorithms into various methods and emphasizing the importance of similarity measures and evaluation in clustering results.
Lexical Analysis
Lexical AnalysisNayemid4676 Lexical analysis is the process of converting a sequence of characters from a source program into a sequence of tokens. It involves reading the source program, scanning characters, grouping them into lexemes and producing tokens as output. The lexical analyzer also enters tokens into a symbol table, strips whitespace and comments, correlates error messages with line numbers, and expands macros. Lexical analysis produces tokens through scanning and tokenization and helps simplify compiler design and improve efficiency. It identifies tokens like keywords, constants, identifiers, numbers, operators and punctuation through patterns and deals with issues like lookahead and ambiguities.
Machine Learning with Decision trees
Machine Learning with Decision treesKnoldus Inc. The document discusses decision trees as a fundamental supervised learning algorithm, outlining their structure, appropriate problem types, and the concepts of entropy and information gain. It addresses common challenges such as overfitting and pruning strategies to improve model performance. The document also highlights the importance of careful tree growth management and validation to ensure accuracy in classifications.
Unsupervised learning
Unsupervised learningamalalhait This document discusses unsupervised learning approaches including clustering, blind signal separation, and self-organizing maps (SOM). Clustering groups unlabeled data points together based on similarities. Blind signal separation separates mixed signals into their underlying source signals without information about the mixing process. SOM is an algorithm that maps higher-dimensional data onto lower-dimensional displays to visualize relationships in the data.
Introduction to Neural Networks
Introduction to Neural NetworksDatabricks The document introduces a series on neural networks, focusing on deep learning fundamentals, including training and applying neural networks with Keras using TensorFlow. It outlines the structure and function of artificial neural networks compared to biological neurons, discussing concepts like activation functions, backpropagation, and optimization techniques. Upcoming sessions will cover topics such as convolutional neural networks and practical applications in various fields.
UNIT - I PROBLEM SOLVING AGENTS and EXAMPLES.pptx.pdf
UNIT - I PROBLEM SOLVING AGENTS and EXAMPLES.pptx.pdfJenishaR1 The document discusses problem-solving agents, particularly focusing on reflex and goal-based agents. It outlines the components necessary for well-defined problems, including initial state, actions, transition model, goal tests, and path costs, and emphasizes the importance of abstraction in problem formulation. Additionally, it provides examples of toy problems and real-world problems, illustrating the diverse applications of problem-solving techniques in fields like route finding and robot navigation.
Reinforcement learning
Reinforcement learning Chandra Meena 1. Reinforcement learning involves an agent learning through trial-and-error interactions with an environment. The agent learns a policy for how to act by maximizing rewards.
2. The document outlines key elements of reinforcement learning including states, actions, rewards, value functions, and explores different methods for solving reinforcement learning problems including dynamic programming, Monte Carlo methods, and temporal difference learning.
3. Temporal difference learning combines the advantages of Monte Carlo methods and dynamic programming by allowing for incremental learning through bootstrapping predictions like dynamic programming while also learning directly from experience like Monte Carlo methods.
Principal component analysis
Principal component analysisPartha Sarathi Kar Principal component analysis (PCA) is a technique used to simplify complex datasets. It works by converting a set of observations of possibly correlated variables into a set of linearly uncorrelated variables called principal components. PCA identifies patterns in data and expresses the data in such a way as to highlight their similarities and differences. The main implementations of PCA are eigenvalue decomposition and singular value decomposition. PCA is useful for data compression, reducing dimensionality for visualization and building predictive models. However, it works best for data that follows a multidimensional normal distribution.
State space search
State space searchchauhankapil This document discusses state space search in artificial intelligence. It defines state space search as consisting of a tree of symbolic states generated by iteratively applying operations to represent a problem. It discusses the initial, intermediate, and final states in state space search. As an example, it describes the water jug problem and its state representation. It also outlines different types of state space search algorithms, including heuristic search algorithms like A* and uninformed search algorithms like breadth-first search.
Uniformed tree searching
Uniformed tree searching Ayaelshiwi This document discusses different search algorithms for traversing tree structures:
- Depth-first search (DFS) explores the deepest paths first, using a stack data structure. It is complete but not optimal.
- Breadth-first search (BFS) explores all nodes at each depth level first, before deeper levels, using a queue. It finds the minimum depth goal node.
- Uniform cost search prioritizes exploring the lowest cost path first, using a priority queue ordered by path cost. It is optimal, finding the least cost goal node.
AI3391 Artificial intelligence Session 28 Resolution.pptx
AI3391 Artificial intelligence Session 28 Resolution.pptxGuru Nanak Technical Institutions The document outlines topics to be covered in an Artificial Intelligence session, including logical reasoning, propositional logic, first-order logic, knowledge representation, inference, and resolution theorem proving. It provides examples of converting statements to clausal form, constructing a resolution proof graph through unification of complementary literals, and uses an example problem to demonstrate resolving "John likes peanuts" through contradiction. The next session will cover forward and backward chaining inference techniques.
Borderline Smote
Borderline SmoteTrector Rancor 1. The document discusses the synthetic minority oversampling technique (SMOTE) for addressing imbalanced data sets where there are many more samples from the majority class than the minority class.
2. SMOTE works by synthesizing new minority class samples rather than oversampling with replacement, helping to reduce overfitting.
3. The document presents several variations of SMOTE, including Borderline-SMOTE1 and Borderline-SMOTE2, which focus on synthesizing samples near the decision boundary to improve classification of the minority class. Experiments show these methods perform better than traditional SMOTE.
Generating function
Generating functionKongunadu College of Engineering and Technology 1. Generating functions can be used to represent sequences as power series and solve recurrence relations.
2. Common examples of generating functions are presented for various sequences like the constant sequence {1,1,...}, the sequence of powers of 2, and binomial coefficients.
3. The process of using generating functions to solve recurrence relations involves rewriting the relation, multiplying by x^n and summing, identifying the generating function, and extracting the nth term.
Python Seaborn Data Visualization
Python Seaborn Data Visualization Sourabh Sahu This document discusses using the Seaborn library in Python for data visualization. It covers installing Seaborn, importing libraries, reading in data, cleaning data, and creating various plots including distribution plots, heatmaps, pair plots, and more. Code examples are provided to demonstrate Seaborn's functionality for visualizing and exploring data.
Data clustering
Data clustering GARIMA SHAKYA The document discusses data clustering, a method of grouping objects based on similarity, and outlines various clustering algorithms such as K-means and fuzzy C-means. It also addresses feature selection methods, advantages and disadvantages of these algorithms, and clustering validation techniques like the Dunn and Davies-Bouldin indices. Applications of clustering include customer segmentation, data summarization, and social network analysis.
Unsupervised learning (clustering)
Unsupervised learning (clustering)Pravinkumar Landge This document discusses various unsupervised machine learning clustering algorithms. It begins with an introduction to unsupervised learning and clustering. It then explains k-means clustering, hierarchical clustering, and DBSCAN clustering. For k-means and hierarchical clustering, it covers how they work, their advantages and disadvantages, and compares the two. For DBSCAN, it defines what it is, how it identifies core points, border points, and outliers to form clusters based on density.
12 pattern recognition
12 pattern recognitionTalal Khaliq This document provides an introduction to pattern recognition, including definitions, applications, and key concepts. It discusses examples of pattern recognition problems like optical character recognition and biometric classification. Important terminology is defined, such as features, feature vectors, decision boundaries, training and test data. Bayesian decision theory is introduced as a framework for pattern recognition that quantifies decision costs. Key concepts explained include priors, likelihoods, posteriors, and the Bayes decision rule for minimizing risk. The example of classifying fish by species is used to illustrate these concepts.
Specification-of-tokens
Specification-of-tokensDattatray Gandhmal The document provides a detailed overview of tokens and their definitions within formal languages, including concepts like alphabet, strings, substrings, and regular expressions (res). It explains how to represent and manipulate strings using concatenation, exponents, and various operations within the framework of regular expressions. Additionally, it illustrates the structure of identifier definitions in programming languages such as C and Pascal, demonstrating how to specify patterns and language constructs.
Hierarchical Clustering
Hierarchical ClusteringCarlos Castillo (ChaTo) The document discusses hierarchical clustering, an algorithmic method in data mining that organizes data into nested clusters visualized as dendrograms. It elaborates on two main types of hierarchical clustering—agglomerative and divisive—detailing their processes, strengths, and limitations. Additionally, it compares different distance metrics used in clustering, such as single-link, complete-link, average-link, and Ward's method, highlighting their impacts on clustering results.
Hierarchical clustering.pptx
Hierarchical clustering.pptxNTUConcepts1 This document discusses hierarchical clustering, an unsupervised learning technique. It describes different types of hierarchical clustering including agglomerative versus divisive approaches. It also discusses dendrograms, which show how clusters are merged or split hierarchically. The document focuses on the agglomerative clustering algorithm and different methods for defining the distance between clusters when they are merged, including single link, complete link, average link, and centroid methods.
Anomaly Detection @Twitter
Anomaly Detection @TwitterZhan Zhang This document discusses Twitter's approach to anomaly detection in time series data. It outlines challenges detecting anomalies at scale, including handling seasonality and multi-modal distributions. The approach uses time series decomposition to remove trends and seasonality, allowing the use of robust statistics like ESD on the residuals to detect outliers. An open source R package was developed applying this approach. It is widely used internally and provides real-time and batch anomaly detection integrated with notification and ticketing systems. Future work includes streaming algorithms and improving robustness.
GAN in medical imaging
GAN in medical imagingCheng-Bin Jin The document summarizes a presentation on applying GANs in medical imaging. It discusses several papers on this topic:
1. A paper that used GANs to reduce noise in low-dose CT scans by training on paired routine-dose and low-dose CT images. This approach generated reconstructed low-dose CT images with improved quality.
2. A paper that used GANs for cross-modality synthesis, specifically generating skin lesion images from other modalities.
3. Additional papers discussed other medical imaging applications of GANs such as vessel-fundus image synthesis and organ segmentation.
Principal Component Analysis and Clustering
Principal Component Analysis and ClusteringUsha Vijay The document discusses the application of principal component analysis (PCA) and clustering techniques to understand borrower segments within a dataset of 27,000 accounts, highlighting different risk categories such as credit-based borrowers and high-risk accounts. It outlines the identification of 18 principal components explaining approximately 76% of the variance, followed by the formation of six clusters using k-means clustering, which are analyzed for financial characteristics and behaviors. Additionally, it details the scoring of new data based on identified segments and reflects on the learning outcomes from the analysis process.
Importing Data Sets | Importing Data Sets | Importing Data Sets
Importing Data Sets | Importing Data Sets | Importing Data SetsAyxanhmdzad This document covers the basics of importing data sets using Python, focusing on key libraries such as pandas, NumPy, SciPy, Matplotlib, Seaborn, and Scikit-learn. It details methods for reading, manipulating, and exporting data using pandas, while also explaining how to connect to SQL databases using Python. The document provides practical examples, including data type checks, statistical summaries, and essential operations for effective data analysis.
import data from Oracle Database into Python Pandas Dataframe
import data from Oracle Database into Python Pandas DataframeJohan Louwers This document provides a tutorial on loading data from an Oracle database into a pandas DataFrame using Python. It outlines the use of the cx_Oracle library, demonstrating a sample code to establish a connection and execute a SQL query. The material serves as an educational example and is not intended for real-world application.
More Related Content
What's hot (20)
Unsupervised learning
Unsupervised learningamalalhait This document discusses unsupervised learning approaches including clustering, blind signal separation, and self-organizing maps (SOM). Clustering groups unlabeled data points together based on similarities. Blind signal separation separates mixed signals into their underlying source signals without information about the mixing process. SOM is an algorithm that maps higher-dimensional data onto lower-dimensional displays to visualize relationships in the data.
Introduction to Neural Networks
Introduction to Neural NetworksDatabricks The document introduces a series on neural networks, focusing on deep learning fundamentals, including training and applying neural networks with Keras using TensorFlow. It outlines the structure and function of artificial neural networks compared to biological neurons, discussing concepts like activation functions, backpropagation, and optimization techniques. Upcoming sessions will cover topics such as convolutional neural networks and practical applications in various fields.
UNIT - I PROBLEM SOLVING AGENTS and EXAMPLES.pptx.pdf
UNIT - I PROBLEM SOLVING AGENTS and EXAMPLES.pptx.pdfJenishaR1 The document discusses problem-solving agents, particularly focusing on reflex and goal-based agents. It outlines the components necessary for well-defined problems, including initial state, actions, transition model, goal tests, and path costs, and emphasizes the importance of abstraction in problem formulation. Additionally, it provides examples of toy problems and real-world problems, illustrating the diverse applications of problem-solving techniques in fields like route finding and robot navigation.
Reinforcement learning
Reinforcement learning Chandra Meena 1. Reinforcement learning involves an agent learning through trial-and-error interactions with an environment. The agent learns a policy for how to act by maximizing rewards.
2. The document outlines key elements of reinforcement learning including states, actions, rewards, value functions, and explores different methods for solving reinforcement learning problems including dynamic programming, Monte Carlo methods, and temporal difference learning.
3. Temporal difference learning combines the advantages of Monte Carlo methods and dynamic programming by allowing for incremental learning through bootstrapping predictions like dynamic programming while also learning directly from experience like Monte Carlo methods.
Principal component analysis
Principal component analysisPartha Sarathi Kar Principal component analysis (PCA) is a technique used to simplify complex datasets. It works by converting a set of observations of possibly correlated variables into a set of linearly uncorrelated variables called principal components. PCA identifies patterns in data and expresses the data in such a way as to highlight their similarities and differences. The main implementations of PCA are eigenvalue decomposition and singular value decomposition. PCA is useful for data compression, reducing dimensionality for visualization and building predictive models. However, it works best for data that follows a multidimensional normal distribution.
State space search
State space searchchauhankapil This document discusses state space search in artificial intelligence. It defines state space search as consisting of a tree of symbolic states generated by iteratively applying operations to represent a problem. It discusses the initial, intermediate, and final states in state space search. As an example, it describes the water jug problem and its state representation. It also outlines different types of state space search algorithms, including heuristic search algorithms like A* and uninformed search algorithms like breadth-first search.
Uniformed tree searching
Uniformed tree searching Ayaelshiwi This document discusses different search algorithms for traversing tree structures:
- Depth-first search (DFS) explores the deepest paths first, using a stack data structure. It is complete but not optimal.
- Breadth-first search (BFS) explores all nodes at each depth level first, before deeper levels, using a queue. It finds the minimum depth goal node.
- Uniform cost search prioritizes exploring the lowest cost path first, using a priority queue ordered by path cost. It is optimal, finding the least cost goal node.
AI3391 Artificial intelligence Session 28 Resolution.pptx
AI3391 Artificial intelligence Session 28 Resolution.pptxGuru Nanak Technical Institutions The document outlines topics to be covered in an Artificial Intelligence session, including logical reasoning, propositional logic, first-order logic, knowledge representation, inference, and resolution theorem proving. It provides examples of converting statements to clausal form, constructing a resolution proof graph through unification of complementary literals, and uses an example problem to demonstrate resolving "John likes peanuts" through contradiction. The next session will cover forward and backward chaining inference techniques.
Borderline Smote
Borderline SmoteTrector Rancor 1. The document discusses the synthetic minority oversampling technique (SMOTE) for addressing imbalanced data sets where there are many more samples from the majority class than the minority class.
2. SMOTE works by synthesizing new minority class samples rather than oversampling with replacement, helping to reduce overfitting.
3. The document presents several variations of SMOTE, including Borderline-SMOTE1 and Borderline-SMOTE2, which focus on synthesizing samples near the decision boundary to improve classification of the minority class. Experiments show these methods perform better than traditional SMOTE.
Generating function
Generating functionKongunadu College of Engineering and Technology 1. Generating functions can be used to represent sequences as power series and solve recurrence relations.
2. Common examples of generating functions are presented for various sequences like the constant sequence {1,1,...}, the sequence of powers of 2, and binomial coefficients.
3. The process of using generating functions to solve recurrence relations involves rewriting the relation, multiplying by x^n and summing, identifying the generating function, and extracting the nth term.
Python Seaborn Data Visualization
Python Seaborn Data Visualization Sourabh Sahu This document discusses using the Seaborn library in Python for data visualization. It covers installing Seaborn, importing libraries, reading in data, cleaning data, and creating various plots including distribution plots, heatmaps, pair plots, and more. Code examples are provided to demonstrate Seaborn's functionality for visualizing and exploring data.
Data clustering
Data clustering GARIMA SHAKYA The document discusses data clustering, a method of grouping objects based on similarity, and outlines various clustering algorithms such as K-means and fuzzy C-means. It also addresses feature selection methods, advantages and disadvantages of these algorithms, and clustering validation techniques like the Dunn and Davies-Bouldin indices. Applications of clustering include customer segmentation, data summarization, and social network analysis.
Unsupervised learning (clustering)
Unsupervised learning (clustering)Pravinkumar Landge This document discusses various unsupervised machine learning clustering algorithms. It begins with an introduction to unsupervised learning and clustering. It then explains k-means clustering, hierarchical clustering, and DBSCAN clustering. For k-means and hierarchical clustering, it covers how they work, their advantages and disadvantages, and compares the two. For DBSCAN, it defines what it is, how it identifies core points, border points, and outliers to form clusters based on density.
12 pattern recognition
12 pattern recognitionTalal Khaliq This document provides an introduction to pattern recognition, including definitions, applications, and key concepts. It discusses examples of pattern recognition problems like optical character recognition and biometric classification. Important terminology is defined, such as features, feature vectors, decision boundaries, training and test data. Bayesian decision theory is introduced as a framework for pattern recognition that quantifies decision costs. Key concepts explained include priors, likelihoods, posteriors, and the Bayes decision rule for minimizing risk. The example of classifying fish by species is used to illustrate these concepts.
Specification-of-tokens
Specification-of-tokensDattatray Gandhmal The document provides a detailed overview of tokens and their definitions within formal languages, including concepts like alphabet, strings, substrings, and regular expressions (res). It explains how to represent and manipulate strings using concatenation, exponents, and various operations within the framework of regular expressions. Additionally, it illustrates the structure of identifier definitions in programming languages such as C and Pascal, demonstrating how to specify patterns and language constructs.
Hierarchical Clustering
Hierarchical ClusteringCarlos Castillo (ChaTo) The document discusses hierarchical clustering, an algorithmic method in data mining that organizes data into nested clusters visualized as dendrograms. It elaborates on two main types of hierarchical clustering—agglomerative and divisive—detailing their processes, strengths, and limitations. Additionally, it compares different distance metrics used in clustering, such as single-link, complete-link, average-link, and Ward's method, highlighting their impacts on clustering results.
Hierarchical clustering.pptx
Hierarchical clustering.pptxNTUConcepts1 This document discusses hierarchical clustering, an unsupervised learning technique. It describes different types of hierarchical clustering including agglomerative versus divisive approaches. It also discusses dendrograms, which show how clusters are merged or split hierarchically. The document focuses on the agglomerative clustering algorithm and different methods for defining the distance between clusters when they are merged, including single link, complete link, average link, and centroid methods.
Anomaly Detection @Twitter
Anomaly Detection @TwitterZhan Zhang This document discusses Twitter's approach to anomaly detection in time series data. It outlines challenges detecting anomalies at scale, including handling seasonality and multi-modal distributions. The approach uses time series decomposition to remove trends and seasonality, allowing the use of robust statistics like ESD on the residuals to detect outliers. An open source R package was developed applying this approach. It is widely used internally and provides real-time and batch anomaly detection integrated with notification and ticketing systems. Future work includes streaming algorithms and improving robustness.
GAN in medical imaging
GAN in medical imagingCheng-Bin Jin The document summarizes a presentation on applying GANs in medical imaging. It discusses several papers on this topic:
1. A paper that used GANs to reduce noise in low-dose CT scans by training on paired routine-dose and low-dose CT images. This approach generated reconstructed low-dose CT images with improved quality.
2. A paper that used GANs for cross-modality synthesis, specifically generating skin lesion images from other modalities.
3. Additional papers discussed other medical imaging applications of GANs such as vessel-fundus image synthesis and organ segmentation.
Principal Component Analysis and Clustering
Principal Component Analysis and ClusteringUsha Vijay The document discusses the application of principal component analysis (PCA) and clustering techniques to understand borrower segments within a dataset of 27,000 accounts, highlighting different risk categories such as credit-based borrowers and high-risk accounts. It outlines the identification of 18 principal components explaining approximately 76% of the variance, followed by the formation of six clusters using k-means clustering, which are analyzed for financial characteristics and behaviors. Additionally, it details the scoring of new data based on identified segments and reflects on the learning outcomes from the analysis process.
Similar to Oracle python pandas merge DataFrames (20)
Importing Data Sets | Importing Data Sets | Importing Data Sets
Importing Data Sets | Importing Data Sets | Importing Data SetsAyxanhmdzad This document covers the basics of importing data sets using Python, focusing on key libraries such as pandas, NumPy, SciPy, Matplotlib, Seaborn, and Scikit-learn. It details methods for reading, manipulating, and exporting data using pandas, while also explaining how to connect to SQL databases using Python. The document provides practical examples, including data type checks, statistical summaries, and essential operations for effective data analysis.
import data from Oracle Database into Python Pandas Dataframe
import data from Oracle Database into Python Pandas DataframeJohan Louwers This document provides a tutorial on loading data from an Oracle database into a pandas DataFrame using Python. It outlines the use of the cx_Oracle library, demonstrating a sample code to establish a connection and execute a SQL query. The material serves as an educational example and is not intended for real-world application.
pandas.pdf
pandas.pdfAjeshSurejan2 Pandas is a Python library used for working with labeled/relational data and time series. It is easy to install Pandas with Anaconda or Miniconda which provide Python distributions with Pandas and other popular data science packages pre-installed. A simple "Hello World" Pandas program can create a DataFrame and display basic descriptive statistics.
pandas (1).pdf
pandas (1).pdfAjeshSurejan2 Pandas is a Python library used for working with labeled/relational data and time series. It is easy to install Pandas with Anaconda or Miniconda which provide Python distributions with Pandas and other popular data science packages pre-installed. A simple "Hello World" program can create a Pandas Series containing descriptive statistics of sample data.
Week2: Programming for Data Analysis
Week2: Programming for Data AnalysisFerdin Joe John Joseph PhD This document discusses merging and concatenating data in pandas. It describes how to use the concat() function to combine data from multiple sources like CSV, JSON, and XML files into a single dataframe. The syntax of concat() is explained and examples are provided of merging different arrays and dataframes, setting axes, performing inner and outer joins, and appending rows. Methods like append() are also covered as alternatives to concat() for combining two dataframes.
Group B - Pandas Pandas is a powerful Python library that provides high-perfo...
Group B - Pandas Pandas is a powerful Python library that provides high-perfo...HarshitChauhan88 The document provides an introduction to the Pandas library in Python, focusing on data structures like DataFrames and Series, and their functionalities for data analysis. It covers key concepts such as data import, manipulation, extraction, and the creation of charts, alongside a detailed overview of basic and advanced DataFrame operations. The document is designed as a resource for students and professionals interested in leveraging Pandas for efficient data handling and analysis.
SciPy 2011 pandas lightning talk
SciPy 2011 pandas lightning talkWes McKinney This document summarizes new and improved features in the pandas library. It describes how pandas provides labeled, structured arrays for heterogeneous data and time series functionality. Major updates include merging DataFrame and DataMatrix into a single optimized DataFrame, better handling of missing data, more robust IO capabilities, and improved pivoting and reshaping of data. Future plans include more powerful group by operations and integration with statsmodels.
python-pandas-For-Data-Analysis-Manipulate.pptx
python-pandas-For-Data-Analysis-Manipulate.pptxPLOKESH8 Pandas is a powerful Python library designed for data manipulation and analysis, providing expressive data structures such as Series and DataFrames. It facilitates the processing of data through functionalities like loading, preparing, manipulating, modeling, and analyzing data across various fields. Pandas also offers efficient tools for handling missing data, reshaping datasets, and performing data preprocessing tasks essential for machine learning applications.
Lecture 3 intro2data
Lecture 3 intro2dataJohnson Ubah The document discusses essential Python toolboxes for data scientists, emphasizing the importance of selecting the right tools for effective data analysis. It highlights popular libraries such as NumPy, SciPy, Pandas, and Scikit-learn, and describes their functionalities for data manipulation, analysis, and machine learning. Additionally, it covers installation options, integrated development environments like Spyder and Jupyter, and various data handling techniques using Pandas.
Pandas csv
Pandas csvDevashish Kumar The document provides a comprehensive overview of CSV files and their manipulation using Python's built-in csv module, including reading, writing, and converting lists to sets. It also introduces the pandas library for data analysis, detailing its data structures such as Series and DataFrame, and describes operations like querying, filtering, and merging data. Additionally, it highlights groupby functionalities and methods to handle missing values in datasets.
Pandas
PandasDr. Chitra Dhawale Pandas is an open-source Python library used for data manipulation and analysis. It allows users to extract data from files like CSVs into DataFrames and perform statistical analysis on the data. DataFrames are the primary data structure and allow storage of heterogeneous data in tabular form with labeled rows and columns. Pandas can clean data by removing missing values, filter rows/columns, and visualize data using Matplotlib. It supports Series, DataFrames, and Panels for 1D, 2D, and 3D labeled data structures.
pandas directories on the python language.pptx
pandas directories on the python language.pptxSumitMajukar Pandas is a Python library used for working with datasets and analyzing data. It allows users to clean messy datasets, explore and manipulate data, and draw conclusions from large datasets based on statistical analysis. Pandas provides functions and methods for loading data from files like CSV and JSON files into DataFrames. DataFrames are the primary data structure in Pandas and act like a 2D spreadsheet with rows and columns. Users can view, clean, and analyze data in DataFrames to gain insights.
Handling Missing Data for Data Analysis.pptx
Handling Missing Data for Data Analysis.pptxRamakrishna Reddy Bijjam This document discusses the handling of missing data in pandas, explaining how to identify, fill, and remove missing values using various functions like isnull(), fillna(), and dropna(). It also covers reshaping dataframes, merging dataframes, and basic plotting techniques with matplotlib, providing examples for each method. Overall, it serves as a comprehensive guide for managing data and visualizations in Python's pandas library.
Complete Introduction To Pandas Python.pptx
Complete Introduction To Pandas Python.pptxARUN R S The document provides an introduction to the Pandas library in Python, emphasizing its capabilities for data analysis and manipulation through efficient data structures like Series and DataFrames. It covers key functionalities such as data importing, cleaning, transformation, and visualization, along with advanced techniques for optimizing performance and managing complex datasets. The document also highlights the importance of addressing real-world data challenges, such as missing values and data quality issues.
Pandas-(Ziad).pptx
Pandas-(Ziad).pptxSivam Chinna Pandas is a Python library used for data manipulation and analysis. It allows users to load, clean, and transform data stored in various file formats like CSV and JSON files into DataFrames. DataFrames are the primary data structure in Pandas and act like a spreadsheet, allowing access and manipulation of data in both rows and columns. Some key operations on DataFrames include viewing data, getting information about the data types and memory usage, handling duplicate rows, understanding variable distributions, and converting data between file formats.
Pandas in Python for Data Exploration .pdf
Pandas in Python for Data Exploration .pdfsejalkadam21 The document provides an overview of the pandas library in Python, highlighting its capabilities for data manipulation, including data frames and series creation, missing data handling, and time series tools. Installation methods, data reading functions, and various operations such as sorting, concatenation, and data analysis functions like mean and correlation are also covered. It serves as a guide for users to effectively utilize pandas for data analysis tasks.
Python Data Wrangling: Preparing for the Future
Python Data Wrangling: Preparing for the FutureWes McKinney The document is a slide deck for a presentation on Python data wrangling and the future of the pandas project. It discusses the growth of the Python data science community and key projects like NumPy, pandas, and scikit-learn that have contributed to pandas' popularity. It outlines some issues with the current pandas codebase and proposes a new C++-based core called libpandas for pandas 2.0 to improve performance and interoperability. Benchmark results show serialization formats like Arrow and Feather outperforming pickle and CSV for transferring data.
Worksheet - python Pandas numerical py pdf
Worksheet - python Pandas numerical py pdfudaywalnandini The document is a worksheet focused on data handling using the Pandas library in Python, providing various coding examples and questions related to DataFrame operations, sorting, and data manipulation. It includes sample code outputs, explanations of methods, and prompts for programming tasks involving Pandas functionality. Key topics covered are creating DataFrames, indexing, sorting data, handling missing values, and aggregating information.
Ad
More from Johan Louwers (20)
Multi Domain REST API routing for Data Mesh based Data Products
Multi Domain REST API routing for Data Mesh based Data ProductsJohan Louwers The document discusses establishing a naming convention for customer-facing APIs within a data mesh environment, focusing on the challenges of exposing various data products across domains. It presents two potential solutions: one using a fully qualified domain name with centralized routing, and another using subdomain-based routing to streamline interactions while noting trade-offs like loss of centralized control. The information is intended for guidance only and not as a commitment to deliver specific features or functionalities.
TClab Dynamic Solar Panel Positioning Systems
TClab Dynamic Solar Panel Positioning SystemsJohan Louwers The document discusses dynamic solar panel positioning systems, focusing on the engineering study of dual-axis positioning that optimizes solar energy capture through precise adjustments of azimuth and altitude angles. Utilizing technologies such as slew drives for azimuth corrections and linear actuators for altitude adjustments, the system improves energy efficiency by tracking the sun's path. Additionally, it highlights the use of the Python package 'pyephem' for calculating solar positions and the integration of various sensors within the TCLab platform for monitoring and control.
Oracle Cloud With Azure DevOps Pipelines
Oracle Cloud With Azure DevOps PipelinesJohan Louwers Oracle Cloud DevOps with Azure Pipelines allows connecting Azure Pipelines to Oracle Cloud Infrastructure (OCI) APIs and deployed components through the use of self-hosted Azure agents running within OCI. This enables full pipeline execution within OCI while leveraging tools like Terraform for infrastructure provisioning and cx_Oracle for working with Oracle databases. Ensuring agents have direct connectivity and aiming for a software-defined automated strategy is recommended over cross-cloud connections.
Oracle Cloud native functions - create application from cli
Oracle Cloud native functions - create application from cliJohan Louwers This document outlines the process for creating applications using Oracle Cloud Functions from the command line interface (CLI). It emphasizes that the information provided is for guidance only and should not be relied upon for purchasing decisions. Additionally, it details the steps required to configure the environment and deploy a serverless function application named 'neptune'.
Oracle Labs - research mission & project potfolio
Oracle Labs - research mission & project potfolioJohan Louwers Oracle Labs conducts a balanced research portfolio encompassing exploratory and directed research, consulting, and product incubation. Key focus areas include computer architecture, distributed systems, machine learning, and programming language research, aimed at improving performance and efficiency across various applications. Current projects involve cloud infrastructure, graph analytics, database processing, and innovative optimization techniques.
Install Redis on Oracle Linux
Install Redis on Oracle LinuxJohan Louwers This document is a quick installation guide for setting up Redis on Oracle Linux, intended for development and personal use. It details steps for installing the EPEL repository, Redis, and configuring network settings while highlighting features and benefits of Oracle Linux. The guide also includes instructions for verifying the installation and ensuring that Redis is functioning correctly.
Fn project quick installation guide
Fn project quick installation guideJohan Louwers This document provides a quick installation guide for FN Project on Oracle Linux:
- It assumes Oracle Linux 7 is installed and the correct yum repositories are enabled.
- Docker is installed using the command "yum -y install docker-engine" and started.
- FN Project is installed by downloading and executing an install script from GitHub.
- FN Project is started using the "fn start" command.
Voice assistants for the insurance industry
Voice assistants for the insurance industry Johan Louwers This document discusses the rapid adoption of voice assistants and the opportunities they present for financial services firms. It notes that voice assistant usage has increased significantly in recent years, especially among younger demographics, and is expected to continue growing quickly. Retail and e-commerce companies have started capitalizing on voice shopping. Now financial services firms need to develop strategies to engage customers through this new voice channel, like using voice assistants to provide personalized products and services or improve customer service. The document argues voice is becoming a critical new interaction method and financial companies must adopt a voice strategy to succeed.
Enterprise wide publish subscribe with Apache Kafka
Enterprise wide publish subscribe with Apache KafkaJohan Louwers The document discusses enterprise wide publish/subscribe models using Apache Kafka. It describes moving from monolithic architectures to microservice architectures and how Kafka can be used to distribute transactions between microservices. It provides examples of publishing and subscribing using Kafka clients and discusses considerations for deploying Kafka in a highly available manner across multiple data centers.
Industry 4.0 and Oracle Cloud
Industry 4.0 and Oracle CloudJohan Louwers The document discusses Industry 4.0 and the integration of artificial intelligence across various cloud and on-premise infrastructures, emphasizing its mathematical basis and processing requirements. It highlights Capgemini's commitment to innovation in consulting and technology services, aiming to help organizations leverage digital transformation. Capgemini, with a diverse workforce of 200,000 members worldwide, generated global revenues of EUR 12.8 billion in 2017.
Docker and microservices - moving from a monolith to microservices
Docker and microservices - moving from a monolith to microservicesJohan Louwers The document discusses moving from a monolithic application architecture to microservices. It begins by stating some ground rules for the presentation. It then discusses how microservices are defined as independently deployable services that communicate via APIs. Docker containers are presented as a way to package and deploy microservices for benefits like automated deployment and scaling. Key differences between containers and virtual machines are highlighted. An example deployment architecture with containers is shown. The document acknowledges that transitioning to microservices and containers will be a long process but will enable benefits like agility, performance and higher release frequency.
Cloud native applications for banking
Cloud native applications for bankingJohan Louwers The document discusses how banks are increasingly adopting cloud-native approaches to application development and deployment to improve business agility, customer experiences, and operational efficiency. It outlines three common uses cases driving cloud-native adoption: 1) transforming the business for greater agility and flexibility, 2) optimizing operational efficiency using public cloud infrastructure, and 3) adopting an API ecosystem. While cloud-native approaches provide benefits, banks face challenges integrating legacy infrastructure and cultural changes. The document recommends banks assess their application portfolio to determine what can be lifted to the cloud, rewritten for cloud, or retired.
Conversational retail
Conversational retailJohan Louwers The document discusses the rise of conversational commerce and the adoption of voice technology by consumers. It highlights Capgemini's leadership in consulting and digital transformation, noting its commitment to innovation and strategic services. The information includes Capgemini's financials and emphasizes its focus on the human aspect of technology-driven business success.
Oracle Cloudday security
Oracle Cloudday securityJohan Louwers The document discusses the harsh realities of enterprise security, emphasizing that organizations should prepare for hacking incidents rather than questioning if they will occur. It provides insights into cyber attacks, their motivations and origins, as well as the risks associated with third-party applications and their impacts on businesses. Additionally, it highlights solutions offered by Oracle, such as machine learning and security analytics, to proactively combat security threats.
Oracle Cloudday - the future of retail
Oracle Cloudday - the future of retailJohan Louwers The document discusses the future of retail in the Oracle Cloud, emphasizing the importance of omni-channel retail models and real-time customer data responsiveness. It outlines various technology solutions and examples, such as mobile pre-ordering, dynamic pricing, and AI-driven customer interaction, leveraging Oracle's cloud services. The hybrid model suggested combines cloud-native solutions with third-party software to enhance retail logistics and customer engagement.
Capgemini Oracle Cloud Access Security Broker
Capgemini Oracle Cloud Access Security BrokerJohan Louwers The Oracle Cloud Access Security Broker (CASB) provides automated security monitoring for cloud applications and workloads, offering features like threat detection, incident response, and security configuration management. It enhances visibility and compliance, enabling organizations to secure cloud environments from day one and automate responses to incidents. Capgemini supports customers in deploying Oracle technology, ensuring optimal solutions and business value through a global network of innovation and consultancy.
Microservices in the oracle cloud
Microservices in the oracle cloudJohan Louwers The document discusses microservices and using the Oracle Container Cloud Service. It introduces Johan Louwers and his background. It then discusses the evolution from monolithic applications to microservices-based applications. It provides an example architecture of using microservices with the Oracle Container Cloud Service, with each microservice running in a Docker container. It describes how the Oracle Integration Cloud Service can provide integration between microservices and other Oracle Cloud services.
Oracle cloud, private, public and hybrid
Oracle cloud, private, public and hybridJohan Louwers The document provides an overview of Oracle's cloud offerings, including insights into public, private, and hybrid cloud models. It emphasizes the importance of choosing the right cloud solution to fit specific needs and discusses the management of hybrid clouds using Oracle's enterprise tools. Additionally, it outlines next steps for customers regarding the consolidation of systems and the use of Oracle's cloud services.
RethinkDB on Oracle Linux
RethinkDB on Oracle LinuxJohan Louwers The document discusses options for running RethinkDB on Oracle Linux. There are three main options: 1) on bare metal servers, 2) within Oracle VM virtual machines, or 3) using Oracle Cloud. A fourth option discussed is using Docker containers with RethinkDB. The document provides guidance on installing RethinkDB, including needing to compile Google Protocol Buffers and using a RethinkDB YUM repository. It also reviews checking the RethinkDB installation and provides contact information.
Oracle Cloud Hybrid Storage Tiering
Oracle Cloud Hybrid Storage TieringJohan Louwers Hybrid storage tiering moves different types of data to the most cost-effective storage tier, whether on-premises or in the cloud. Using Oracle's hybrid storage tiering:
- Hot and warm data remains on-premises, while cold and archive data moves to lower-cost storage in Oracle Cloud.
- The Oracle Storage Cloud Software Appliance provides a bridge between on-premises and cloud storage, allowing for easy data movement with POSIX compliance.
- This hybrid approach lowers overall storage costs by paying only for cloud storage as data is used, versus maintaining all storage on-premises.
Ad
Recently uploaded (20)
Raman Bhaumik - Passionate Tech Enthusiast
Raman Bhaumik - Passionate Tech EnthusiastRaman Bhaumik A Junior Software Developer with a flair for innovation, Raman Bhaumik excels in delivering scalable web solutions. With three years of experience and a solid foundation in Java, Python, JavaScript, and SQL, she has streamlined task tracking by 20% and improved application stability.
Agentic AI for Developers and Data Scientists Build an AI Agent in 10 Lines o...
Agentic AI for Developers and Data Scientists Build an AI Agent in 10 Lines o...All Things Open Presented at All Things Open RTP Meetup
Presented by William Hill - Developer Advocate, NVIDIA
Title: Agentic AI for Developers and Data Scientists
Build an AI Agent in 10 Lines of Code and the Concepts Behind the Code
Abstract: In this talk we will demonstrate building a working data science AI agent in 10 lines of basic Python code in a Colab notebook. Our AI Agent will perform LLM prompt-driven visual analysis using open-source libraries. In this session we will show how to develop an AI Agent using GPUs through NVIDIA’s developer program and Google Colab notebooks. After coding our AI Agent, we will break down the 10 lines of code. We will show the key components and open source library integrations that enable the agent's functionality, focusing on practical implementation details and then the theoretical concepts. The presentation concludes with a survey of current LLM technologies and the latest trends in developing AI applications for enthusiasts and enterprises
Security Tips for Enterprise Azure Solutions
Security Tips for Enterprise Azure SolutionsMichele Leroux Bustamante Delivering solutions to Azure may involve a variety of architecture patterns involving your applications, APIs data and associated Azure resources that comprise the solution. This session will use reference architectures to illustrate the security considerations to protect your Azure resources and data, how to achieve Zero Trust, and why it matters. Topics covered will include specific security recommendations for types Azure resources and related network security practices. The goal is to give you a breadth of understanding as to typical security requirements to meet compliance and security controls in an enterprise solution.
Enhance GitHub Copilot using MCP - Enterprise version.pdf
Enhance GitHub Copilot using MCP - Enterprise version.pdfNilesh Gule Slide deck related to the GitHub Copilot Bootcamp in Melbourne on 17 June 2025
Securing Account Lifecycles in the Age of Deepfakes.pptx
Securing Account Lifecycles in the Age of Deepfakes.pptxFIDO Alliance Securing Account Lifecycles in the Age of Deepfakes
Database Benchmarking for Performance Masterclass: Session 2 - Data Modeling ...
Database Benchmarking for Performance Masterclass: Session 2 - Data Modeling ...ScyllaDB Specific best practices and pitfalls for benchmarking popular high-performance databases.
Quantum AI Discoveries: Fractal Patterns Consciousness and Cyclical Universes
Quantum AI Discoveries: Fractal Patterns Consciousness and Cyclical UniversesSaikat Basu Embark on a cosmic journey exploring the intersection of quantum
computing, consciousness, and ancient wisdom. Together we'll uncover the
recursive patterns that bind our reality.
GenAI Opportunities and Challenges - Where 370 Enterprises Are Focusing Now.pdf
GenAI Opportunities and Challenges - Where 370 Enterprises Are Focusing Now.pdfPriyanka Aash GenAI Opportunities and Challenges - Where 370 Enterprises Are Focusing Now
"How to survive Black Friday: preparing e-commerce for a peak season", Yurii ...
"How to survive Black Friday: preparing e-commerce for a peak season", Yurii ...Fwdays We will explore how e-commerce projects prepare for the busiest time of the year, which key aspects to focus on, and what to expect. We’ll share our experience in setting up auto-scaling, load balancing, and discuss the loads that Silpo handles, as well as the solutions that help us navigate this season without failures.
“MPU+: A Transformative Solution for Next-Gen AI at the Edge,” a Presentation...
“MPU+: A Transformative Solution for Next-Gen AI at the Edge,” a Presentation...Edge AI and Vision Alliance For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2025/06/mpu-a-transformative-solution-for-next-gen-ai-at-the-edge-a-presentation-from-fotonation/
Petronel Bigioi, CEO of FotoNation, presents the “MPU+: A Transformative Solution for Next-Gen AI at the Edge” tutorial at the May 2025 Embedded Vision Summit.
In this talk, Bigioi introduces MPU+, a novel programmable, customizable low-power platform for real-time, localized intelligence at the edge. The platform includes an AI-augmented image signal processor that enables leading image and video quality.
In addition, it integrates ultra-low-power object and motion detection capabilities to enable always-on computer vision. A programmable neural processor provides flexibility to efficiently implement new neural networks. And additional specialized engines facilitate image stabilization and audio enhancements.
Connecting Data and Intelligence: The Role of FME in Machine Learning
Connecting Data and Intelligence: The Role of FME in Machine LearningSafe Software In this presentation, we want to explore powerful data integration and preparation for Machine Learning. FME is known for its ability to manipulate and transform geospatial data, connecting diverse data sources into efficient and automated workflows. By integrating FME with Machine Learning techniques, it is possible to transform raw data into valuable insights faster and more accurately, enabling intelligent analysis and data-driven decision making.
Salesforce Summer '25 Release Frenchgathering.pptx.pdf
Salesforce Summer '25 Release Frenchgathering.pptx.pdfyosra Saidani Salesforce Summer '25 Release Frenchgathering.pptx.pdf
Coordinated Disclosure for ML - What's Different and What's the Same.pdf
Coordinated Disclosure for ML - What's Different and What's the Same.pdfPriyanka Aash Coordinated Disclosure for ML - What's Different and What's the Same
Tech-ASan: Two-stage check for Address Sanitizer - Yixuan Cao.pdf
Tech-ASan: Two-stage check for Address Sanitizer - Yixuan Cao.pdfcaoyixuan2019 A presentation at Internetware 2025.
Mastering AI Workflows with FME by Mark Döring
Mastering AI Workflows with FME by Mark DöringSafe Software Harness the full potential of AI with FME: From creating high-quality training data to optimizing models and utilizing results, FME supports every step of your AI workflow. Seamlessly integrate a wide range of models, including those for data enhancement, forecasting, image and object recognition, and large language models. Customize AI models to meet your exact needs with FME’s powerful tools for training, optimization, and seamless integration
Oh, the Possibilities - Balancing Innovation and Risk with Generative AI.pdf
Oh, the Possibilities - Balancing Innovation and Risk with Generative AI.pdfPriyanka Aash Oh, the Possibilities - Balancing Innovation and Risk with Generative AI
The Growing Value and Application of FME & GenAI
The Growing Value and Application of FME & GenAISafe Software With the cost of using Generative AI services dropping exponentially and the array of available models continually expanding, integrating AI into FME workflows has become inexpensive, accessible and effective. This presentation explores how GenAI within FME can cost-effectively transform data workflows by automating data extraction, validation, classification and augmentation tasks. We’ll discuss how FME’s no-code flexibility enables users to combine Generative AI and Computer Vision tools that create efficient workflows tailored to specific challenges. Using recent practical examples, we’ll demonstrate how these integrations can simplify complex tasks, save time and enhance data quality.
Using the SQLExecutor for Data Quality Management: aka One man's love for the...
Using the SQLExecutor for Data Quality Management: aka One man's love for the...Safe Software The SQLExecutor is one of FME’s most powerful and flexible transformers. Pivvot maintains a robust internal metadata hierarchy used to support ingestion and curation of thousands of external data sources that must be managed for quality before entering our platform. By using the SQLExecutor, Pivvot can efficiently detect problems and perform analysis before data is extracted from our staging environment, removing the need for rollbacks or cycles waisted on a failed job. This presentation will walk through three distinct examples of how Pivvot uses the SQLExecutor to engage its metadata hierarchy and integrate with its Data Quality Management workflows efficiently and within the source postgres database. Spatial Validation –Validating spatial prerequisites before entering a production environment. Reference Data Validation - Dynamically validate domain-ed columns across any table and multiple columns per table. Practical De-duplication - Removing identical or near-identical well point locations from two distinct source datasets in the same table.
“MPU+: A Transformative Solution for Next-Gen AI at the Edge,” a Presentation...
“MPU+: A Transformative Solution for Next-Gen AI at the Edge,” a Presentation...Edge AI and Vision Alliance
Oracle python pandas merge DataFrames
- 1. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Python Development Example Merge Pandas DataFrame Johan Louwers – Chief Customer Architect @ Oracle Version : Feb 2019 @johanlouwers Johanlouwers.blogspot.com Oracle Confidential – Internal/Restricted/Highly Restricted
- 2. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. 2
- 3. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | Python Development with pandas and CX_Oracle Slide-deck Intention : • This presentation is intended to provide a quick introduction example on how to merge two DataFrames in Pandas • This example is a part of a wider workshop deck and shared as a stand- alone example for ease of sharing. • The code should only be used as an educational example and is not intended to be included in any real- world application code. 3 Contact details : Johan Louwers - Chief Customer Architect @johanlouwers [email protected] github.com/louwersj Johanlouwers.blogspot.com
- 4. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | A B C D 0 A0 B0 C0 D0 1 A1 B1 C1 D1 2 A2 B2 C2 D2 4 A B C D 0 A0 B0 C0 D0 1 A1 B1 C1 D1 2 A2 B2 C2 D2 A B C_x D_x C_y D_y 0 A0 B0 C0 D0 C0 D0 1 A1 B1 C1 D1 C1 D1 2 A2 B2 C2 D2 C2 D2 pd.read_csv pd.read_csv pd.merge Python Development Pandas – merge DataFrame What do we want to achieve? 1) Load two sets of data from .csv files 2) “merge” them into a single dataframe
- 5. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 5 import pandas as pd df0 = pd.read_csv('../../data/dataset_4.csv', delimiter=";",) print ('show the content of the first file via dataframe df0') print (df0.head()) df1 = pd.read_csv('../../data/dataset_5.csv', delimiter=";",) print ('show the content of the second file via dataframe df1') print (df1.head()) df2 = pd.merge(df0, df1, on=['Country Code','Country Name']) print ('show the content of merged dataframes as a single dataframe') print (df2.head()) Python Development Pandas – merge DataFrame Read first CSV file Read second CSV file Merge DataFrames Show me the code 1) Please note the 3 steps in the above code (two times read_csv() and one merge() 2) Find example at : https://github.com/louwersj/examples_machineLearning/blob/master/pandas/merging/pd_merge_example_1.py
- 6. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 6 Python Development Pandas – merge DataFrame Show me the output 1) Do note that the two “original” dataFrame objects contain each 63 columns 2) Do note that the “merged” DataFrame contains 124 columns and not 126 columns.
- 7. Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 7