Big Data Analytics Lab

The Big Data Analytics Lab is ran by Dr. Loni Hagen at the University of South Florida. The team uses big data to solve real world problems. Big data analytics enable data driven decision making by leveraging the power of data. If you are an editor, please see the SideBar for useful information (such as new page Templates).

Note: This Wiki is under constant construction. Pages may be in various stages of completeness.

Data Collection 

• Twitter API
• Twitter Data Collection Workshop
• CrowdTangle 
• Make Twitter Location Search Easy with Pam’s Pin -- Convert a street address to a location-based Twitter search.
• Reddit Data Collection: https://www.reddit.com/r/redditdev/comments/18lda6b/presenting_open_source_tool_that_collects_reddit/  or https://github.com/socius-org/RedditHarbor/  

Data Storage and Retrieval

• CIRCE Tutorial
• Research Computing

Data Manipulation/Cleaning

• tidyverse
• data.tables

Analytic Methods/AI Tools 

• NLP document similarity
• Bot Detection Workshop
• Google Trends in R: gtrendsR package
• Content Analysis
• Manual Annotation
• Ad Hoc Analysis
• Gender detection algorithm
• DCiFR (Demographic Characteristics in Facial Recognition): Parsing Demographic Characteristics from an Image 
• Presentation video on use of DCiFR for analyzing academic pay gap 
• Network Analysis
• Network Analysis Workshop 
• Network analysis tool based on reference information (for social scientists, no programming necessary)
• Sentiment Analysis
• Sentiment Analysis Workshop  
• Topic Modeling 
• Word2Vec and word embedding: youtube-- https://www.youtube.com/watch?v=L-v09eL3XoA   , Blog: https://towardsdatascience.com/introduction-to-word-embedding-and-word2vec-652d0c2060fa 
•  

Visualization Tools/Others

• Julia Makie 
• Gephi (social network analysis and visualization) 
• Graphistry (take up to million nodes): https://github.com/graphistry/pygraphistry  
• tableau:  Our COVID data work on Government Social Media activities during the year of 2020 is here
• Github Workshop 

Learning Python

• Using Google Colab

Misinformation

• Google FactCheck Tool API

External Links

• USF's School of Information
• Dr. Loni Hagen's WordPress
• Big Data Analytics Lab Github

Lab Activities

• Meeting Minutes 

iSchool Curriculum for Data Science Education (iDSCC Committee)