Please submit electronic copies of your answers (scanned handwriting is perfectly acceptable) via MyPlace by Monday 23/11/2020. Your answers should contain appropriate plots of your results with any annotations and brief discussions or justifications of your answers. If you submit Q1 one week prior (by 16/11), I will give you written feedback and you will have the chance to update your submission.

Please submit your solution by the beginning of the week 7 lecture (Monday, Nov 16). Submissions should be made on gradescope. Please complete homework individually. These homework exercises are intended to help you get started on potential solutions to Assignment 1. We’ll work directly with the Assignment 1 dataset to complete them, which is available from: http://cseweb.ucsd.edu/classes/fa20/cse258-a/files/assignment1.tar.gz You’ll probably want to implement your solution by modifying the baseline code provided. The competition pages can be found here: Kaggle links to appear during week 4 Please include the code of (the important parts of) your solutions.

There are 6 questions of equal value. Attempt all questions. Show all working. The last 3 pages have a list of useful formulae.

You will be allocated an individual data set, which is unique to you. Only use your own data. The allocation is in a file “Data.Allocation.2020.csv”. Email the lecturer if your name isn’t there. Solutions should be submitted via Canvas by 4pm on Friday 6 November. Solutions should be in the form of a csv file, named “MAS2904.Ex1.XXX.csv”, with “XXX” replaced by your data set number as three digits, ie including leading zeros if necessary, so “MAS2904.Ex1.001.csv”, . . . “MAS2904.Ex1.010.csv”,. . . “MAS2904.Ex1.100.csv”, . . .. A template is provided. Put all your solutions in the second column. The data relate to the number of deaths due to a particular condition in acute hospital trusts in two different time periods. You will be provided with a sample of 50 trusts.

The nefarious Dr. Evil has planted a slew of “binary bombs” on our servers. A binary bomb is a program that consists of a sequence of phases. Each phase expects you to type a particular string on stdin. If you type the correct string, then the phase is defused and the bomb proceeds to the next phase. Otherwise, the bomb explodes by printing “BOOM!!!” (or something similar) and then terminating. The bomb is defused when every phase has been defused.

Your project will be on a topic chosen by you. It should involve analysis of a dataset (that you identify) to answer a specific question or set of questions. You should use your dataset to demonstrate your mastery of the broad topics we have covered in this course. Those topics are: 1. Producing high quality graphics 2. Producing high quality tables 3. Wrangling data 4. Handling missing data 5. Hierarchical modelling 6. Spatial mapping 7. Hypothesis testing It expected that high quality graphics and tables, and some degree of data wrangling are expected. Then you should choose two of missing data, hierarchical modelling, spatial mapping and hypothesis testing to deomstrate. In addition, you should demonstrate your ability to go beyond what you have been taught and conduct some self-directed learning, i.e. use some R package not covered in the course, or extend some of the ideas covered, or demonstrate a deeper understanding of a topic through your own exploration.

For the final project, you will formulate, analyze, and solve an optimization problem sing the tools you have learned in class. You will work in a group to develop a strategy, explore a provided dataset, develop and analyze your problem formulations, and write a report describing your approach and what you have learned.

The movement of data from a source system to a destination system often requires the data to be reformatted to meet the input requirements of the destination systems. Source systems range from sensor data from a hardware system (like solar panel operating data) to rows extracted from a database system. Target systems can be other devices or a different database system. In the world of enterprise data management this data movement process is broadly called ETL, Extract, Transform and Load processing. ETL software may be purchased from vendors but is often custom written to meet the unique requirements of the output data format of the source systems and the input data format of the target system.

You have inherited some buggy code for comparing JSON objects. Your boss has fired the previous developer because they did not do any testing and did not fix the bugs! She has hired you to debug and fix the code. She will provide you with some unit tests (some of which fail), sample input that exhibits bugginess, and sample output of what should be produced. Your job is to fix the bugs or explain why they can’t be easily fixed: Both the bugs exhibited by the unit tests and the ones by the input. Good luck!

Please make sure that you always use notations consistent with lecture notes. Different notations will not be accepted. The deadline for assignment 2 is: Wed 18, Nov 5:00 pm