---
url: 'https://wagner.nyu.edu/education/courses/large-scale-data-analysis-machine-learning-i'
title: 'Large Scale Data Analysis with Machine Learning I'
author:
  name: mi22
  url: 'https://wagner.nyu.edu/users/mi22'
date: '2016-10-24T19:21:49+00:00'
updated: '2026-02-17T21:09:44+00:00'
type: course
summary: "The past decade has seen the increasing availability of very large scale data sets, arising from the rapid growth of transformative technologies such as the Internet and cellular telephones, along with the development of new and powerful computational methods to analyze such datasets. Such methods, developed in the closely related fields of machine learning, data mining, and artificial intelligence, provide a powerful set of tools for intelligent problem-solving and data-driven policy analysis. These methods have the potential to dramatically improve the public welfare by guiding policy decisions and interventions, and their incorporation into intelligent information systems will improve public services in domains ranging from medicine and public health to law enforcement and security.The LSDA course series will provide a basic introduction to large scale data analysis methods, focusing on four main problem paradigms (prediction, clustering, modeling, and detection). The first course (LSDA I) will focus on prediction (both classification and regression) and clustering (identifying underlying group structure in data), while the second course (LSDA II) will focus on probabilistic modeling using Bayesian networks and on anomaly and pattern detection. \_LSDA I is a prerequisite for LSDA II, as a number of concepts from classification and clustering will be used in the Bayesian networks and anomaly detection modules, and students are expected to understand these without the need for extensive review.In both LSDA I and LSDA II, students will learn how to translate policy questions into these paradigms, choose and apply the appropriate machine learning and data mining tools, and correctly interpret, evaluate, and apply the results for policy analysis and decision making. We will emphasize tools that can \"scale up\" to real-world policy problems involving reasoning in complex and uncertain environments, discovering new and useful patterns, and drawing inferences from large amounts of structured, high-dimensional, and multivariate data.No previous knowledge of machine learning or data mining is required, and no knowledge of computer programming is required. \_We will be using Weka, a freely available and easy-to-use machine learning and data mining toolkit, to analyze data in this course.The course video provides more information."
tags:
  - 'Adv. Certificate - Program Evaluation and Impact Assessment - Constrained Elective'
  - 'Adv. Certificate - Quantitative Methods for Policy Analysis - Constrained Elective'
  - 'Health Policy Analysis - Analytic Methods'
  - 'MSPP - Methods Electives'
  - 'MUP - Urban Analytics - Elective Focus Area'
  - 'Policy - Data Science - Elective Focus Area'
  - '4147'
  - Spring
  - PADM-GP
  - 'Data Science and Data Management'
published: true
schema:
  '@context': 'https://schema.org'
  '@graph':
    -
      '@type': Course
      name: 'Large Scale Data Analysis with Machine Learning I'
      description: "The past decade has seen the increasing availability of very large scale data sets, arising from the rapid growth of transformative technologies such as the Internet and cellular telephones, along with the development of new and powerful computational methods to analyze such datasets. Such methods, developed in the closely related fields of machine learning, data mining, and artificial intelligence, provide a powerful set of tools for intelligent problem-solving and data-driven policy analysis. These methods have the potential to dramatically improve the public welfare by guiding policy decisions and interventions, and their incorporation into intelligent information systems will improve public services in domains ranging from medicine and public health to law enforcement and security.The LSDA course series will provide a basic introduction to large scale data analysis methods, focusing on four main problem paradigms (prediction, clustering, modeling, and detection). The first course (LSDA I) will focus on prediction (both classification and regression) and clustering (identifying underlying group structure in data), while the second course (LSDA II) will focus on probabilistic modeling using Bayesian networks and on anomaly and pattern detection. \_LSDA I is a prerequisite for LSDA II, as a number of concepts from classification and clustering will be used in the Bayesian networks and anomaly detection modules, and students are expected to understand these without the need for extensive review.In both LSDA I and LSDA II, students will learn how to translate policy questions into these paradigms, choose and apply the appropriate machine learning and data mining tools, and correctly interpret, evaluate, and apply the results for policy analysis and decision making. We will emphasize tools that can \"scale up\" to real-world policy problems involving reasoning in complex and uncertain environments, discovering new and useful patterns, and drawing inferences from large amounts of structured, high-dimensional, and multivariate data.No previous knowledge of machine learning or data mining is required, and no knowledge of computer programming is required. \_We will be using Weka, a freely available and easy-to-use machine learning and data mining toolkit, to analyze data in this course.The course video provides more information."
      provider:
        '@type': Organization
        '@id': 'https://wagner.nyu.edu/'
        name: 'NYU Wagner'
        url: 'https://wagner.nyu.edu/'
      courseCode: PADM-GP.4147
      coursePrerequisites: CORE-GP.1011
      educationalCredentialAwarded: '1.5 credits'
---
Course Subject

PADM-GP

 

. Course Number

4147

 

 - Course Credit

1.5

 

 points 

 

# Large Scale Data Analysis with Machine Learning I

- <a aria-controls="tabpanel-course-description" aria-selected="true" id="tab-course-description" role="tab" tabindex="0"> Description </a>
- <a aria-controls="tabpanel-course-field_course_syllabus" aria-selected="false" id="tab-course-field_course_syllabus" role="tab" tabindex="-1"> Syllabus </a>
 
 

 <a aria-label="Description - Click to expand or collapse" tabindex="-1"> Description     </a> 

Course Description

The past decade has seen the increasing availability of very large scale data sets, arising from the rapid growth of transformative technologies such as the Internet and cellular telephones, along with the development of new and powerful computational methods to analyze such datasets. Such methods, developed in the closely related fields of machine learning, data mining, and artificial intelligence, provide a powerful set of tools for intelligent problem-solving and data-driven policy analysis. These methods have the potential to dramatically improve the public welfare by guiding policy decisions and interventions, and their incorporation into intelligent information systems will improve public services in domains ranging from medicine and public health to law enforcement and security.

The LSDA course series will provide a basic introduction to large scale data analysis methods, focusing on four main problem paradigms (prediction, clustering, modeling, and detection). The first course (LSDA I) will focus on prediction (both classification and regression) and clustering (identifying underlying group structure in data), while the second course (LSDA II) will focus on probabilistic modeling using Bayesian networks and on anomaly and pattern detection.  LSDA I is a prerequisite for LSDA II, as a number of concepts from classification and clustering will be used in the Bayesian networks and anomaly detection modules, and students are expected to understand these without the need for extensive review.

In both LSDA I and LSDA II, students will learn how to translate policy questions into these paradigms, choose and apply the appropriate machine learning and data mining tools, and correctly interpret, evaluate, and apply the results for policy analysis and decision making. We will emphasize tools that can "scale up" to real-world policy problems involving reasoning in complex and uncertain environments, discovering new and useful patterns, and drawing inferences from large amounts of structured, high-dimensional, and multivariate data.

No previous knowledge of machine learning or data mining is required, and no knowledge of computer programming is required.  We will be using Weka, a freely available and easy-to-use machine learning and data mining toolkit, to analyze data in this course.

The [course video](https://stream.nyu.edu/media/Large-Scale+Data+Analysis+I+and+II+-+PADM-GP+4147+%26+4148/1_57rcvotq) provides more information.



 

Prerequisites

CORE-GP.1011



 

Semester

Spring

 

 

Focus Area

[Data Science and Data Management](/taxonomy/term/8783911)

 

 

 

 

 <a aria-label="Syllabus - Click to expand or collapse" tabindex="-1"> Syllabus     </a> 

### Spring 2026 PADM-GP 4147.001

Course Title

[Large Scale Data Analysis with Machine Learning I](/education/courses/large-scale-data-analysis-machine-learning-i)

 

Faculty

[Daniel B. Neill](/community/faculty/daniel-b-neill)

 

 



[Download Syllabus (login required)](https://wagner.nyu.edu/saml/login?destination=/system/files/syllabi/202601/Syllabus-for-LSDA-I-Spring-2026-accessible_0.pdf)

---



### Spring 2025 PADM-GP 4147.001

Course Title

[Large Scale Data Analysis with Machine Learning I](/education/courses/large-scale-data-analysis-machine-learning-i)

 

Faculty

[Daniel B. Neill](/community/faculty/daniel-b-neill)

 

 



[Download Syllabus (login required)](https://wagner.nyu.edu/saml/login?destination=/system/files/syllabi/202501/Syllabus%20for%20LSDA%20I%2C%20Spring%202025.pdf)

---



### Spring 2024 PADM-GP 4147.001

Course Title

[Large Scale Data Analysis with Machine Learning I](/education/courses/large-scale-data-analysis-machine-learning-i)

 

Faculty

[Daniel B. Neill](/community/faculty/daniel-b-neill)

 

 



[Download Syllabus (login required)](https://wagner.nyu.edu/saml/login?destination=/system/files/syllabi/202401/Syllabus%20for%20LSDA%20I%2C%20Spring%202024.pdf)

---