home
techred home > dat-310

DTAN-310: BIG Data | Carlow University | Spring 2023

course wk no. date session links learning objectives completion targets
DTAN-310 1 Monday
9-JAN-2023

Articulate the key themes of the BIG Data class

Dig into python langauge fundamentals with the introductory exercises

DTAN-310 Wednesday
11-JAN-2023

Basic data structures

Practice data types

DTAN-310 2 Monday
9-JAN-2023

{no class} Martin Luther King Jr. Day

DTAN-310 Wednesday
18-JAN-2023

Practice function design with R homework

Basic file input/output

DTAN-310 3 Monday
23-JAN-2023

File input and output

Dedicate a few hours to adapting/customizing examples in w3 schools python tutorials, starting with Variables and working through a few sections. Goal: get through Dictionaries by Monday.

DTAN-310 Wednesday
25-JAN-2023

Function and file basics

DTAN-310 4 Monday
30-JAN-2023

Finish Dog tag data digestion together; Choose next data set for practice.

Use loops to assemble basic data statistics.

Small task for Wednesday:

# Dog Tag Task #3

# Dog Tag Task #3
# Then list all dog names that are exactly two characters long
# BONUS: how many dogs were given each of these two lettered names
# BONUS: which dog name(s) is the longest of any issued and what name was that?
# hint, you can ask strings their length with len()

Make a good faith effort at review problems tied to these sections, to be posted here on Wednesday

Digest w3schools python tutorials THROUGH functions by Monday, 6-FEB

State Population Growth project

Dedicate substantial time to building our state population growth tool using our guide.

DTAN-310 Wednesday
1-FEB-2023

Review progress on python tutorials on w3 schools.

Follow specificaitons to write functions that take in desired inputs and produce required outputs.

DTAN-310 5 Monday
6-FEB-2023

Work through state population examples

Wrap a bow on the state population problems and make a good leap into county parcel processing.

DTAN-310 Wednesday
8-FEB-2023

Create a smaller data set from a larger one using python.

DTAN-310 6 Monday
13-FEB-2023

Ingesting a very large file!

DTAN-310 Wednesday
15-FEB-2023

Continue work on parcel file from WPRDC

How long does your program take to run, in seconds?

DTAN-310 7 Monday
20-FEB-2023

Using datetime module's datetime.now() function to time programs

JSON Encoding module documented at python.org

Pursue the capital projects JSON-encoded search project

Use a JSON linter

Using our sample json tool, write a program that does the following:

  1. Read in our schedule file and display the schedule to the user
  2. Ask the user for a time, and then a description of the event.
  3. Finally, ask the user for an output filename.
  4. The program should then add the user's event and description to our conference schedule and write that data to the inputted file in JSON format.
  5. Extension: Before writing the conference schedule, make sure the events are ordered correctly based on their time. Use 24-hour time to make your life easier.
  6. Extension: After writing the file out, write out a summary of the schedule including total number of events, and if you feel wrestless, the total time the conference from the first to the last event.
DTAN-310 Wednesday
22-FEB-2023

API project work

DTAN-310 8 Monday
27-FEB-2023

Intro to API data from the NHTSA

Make requests to a remote computer and process the results in python, eventually using pandas

Over Break:

  1. Finish the mini project on assembling the highest recalled vehicle
  2. Extension: write a function that takes in a single make, and outputs the highest recall count model for each available year
  3. Find yourself a free api that gets you data you have an intrest in crunching. Try signing up for an API key if needed and see if you can write a really simple program to get some kind of data out of your API.
DTAN-310 Wednesday
1-MAR-2023

Build API calls with NHTSA

DTAN-310 xxx Monday
9-JAN-2023
Wednesday
11-JAN-2023

SPRING BREAK: NO CLASSES

DTAN-310 9 Monday
13-MAR-2023

DTAN-310 Wednesday
15-MAR-2023

DTAN-310 10 Monday
20-MAR-2023

DTAN-310 Wednesday
22-MAR-2023

DTAN-310 11 Monday
27-MAR-2023

Intro to pandas and mat plot library for visualization of data

See techred index for pandas and related libraries

Make basic tables and plots from those tables in pandas and matplotlib

DTAN-310 Wednesday
29-MAR-2023

DTAN-310 12 Monday
3-APR-2023

DTAN-310 Wednesday
5-APR-2023

DTAN-310 13 Monday
10-APR-2023

No Class; Religious Holiday Observance

DTAN-310 Wednesday
12-APR-2023

DTAN-310 14 Monday
17-APR-2023

DTAN-310 Wednesday
19-APR-2023

Continue database fundamentals

DTAN-310 15 Monday
24-APR-2023

Designing your custom database in PostgreSQL

Create a sql script for creating a database with two or more tables related to one another with foreign keys

Prepare to write your API data into your postgres DB

DTAN-310 Wednesday
26-APR-2023

Final day of database design

Write enough data into your database that you have used each of your columns and tables

DTAN-310 16 FINAL
Thursday
4-MAY-2023

From 3:30 to 5:30 pm

Share database projects

Engage deeply with databases

No more class, No more todos!