User:Jan Spousta/sandbox

From Wikipedia, the free encyclopedia
Jump to: navigation, search

66 job interview questions for data scientists Posted by Vincent Granville on February 13, 2013 at 8:00pmView Blog.These are mostly open-ended questions, to assess the technical horizontal knowledge of a senior candidate at a high level. 1.What is the biggest data set that you processed, and how did you process it, what were the results? 2.Tell me two success stories about your analytic or computer science projects? How was lift (or success) measured? 3.What is: lift, KPI, robustness, model fitting, design of experiments, 80/20 rule? 4.What is: collaborative filtering, n-grams, map reduce, cosine distance? 5.How to optimize a web crawler to run much faster, extract better information, and better summarize data to produce cleaner databases? 6.How would you come up with a solution to identify plagiarism? 7.How to detect individual paid accounts shared by multiple users? 8.Should click data be handled in real time? Why? In which contexts? 9.What is better: good data or good models? And how do you define "good"? Is there a universal good model? Are there any models that are definitely not so good? 10.What is probabilistic merging (AKA fuzzy merging)? Is it easier to handle with SQL or other languages? Which languages would you choose for semi-structured text data reconciliation? 11.How do you handle missing data? What imputation techniques do you recommend? 12.What is your favorite programming language / vendor? why? 13.Tell me 3 things positive and 3 things negative about your favorite statistical software. 14.Compare SAS, R, Python, Perl 15.What is the curse of big data? 16.Have you been involved in database design and data modeling? 17.Have you been involved in dashboard creation and metric selection? What do you think about Birt? 18.What features of Teradata do you like? 19.You are about to send one million email (marketing campaign). How do you optimze delivery? How do you optimize response? Can you optimize both separately? (answer: not really) 20.Toad or Brio or any other similar clients are quite inefficient to query Oracle databases. Why? How would you do to increase speed by a factor 10, and be able to handle far bigger outputs? 21.How would you turn unstructured data into structured data? Is it really necessary? Is it OK to store data as flat text files rather than in an SQL-powered RDBMS? 22.What are hash table collisions? How is it avoided? How frequently does it happen? 23.How to make sure a mapreduce application has good load balance? What is load balance? 24.Examples where mapreduce does not work? Examples where it works very well? What are the security issues involved with the cloud? What do you think of EMC's solution offering an hybrid approach - both internal and external cloud - to mitigate the risks and offer other advantages (which ones)? 25.Is it better to have 100 small hash tables or one big hash table, in memory, in terms of access speed (assuming both fit within RAM)? What do you think about in-database analytics? 26.Why is naive Bayes so bad? How would you improve a spam detection algorithm that uses naive Bayes? 27.Have you been working with white lists? Positive rules? (In the context of fraud or spam detection) 28.What is star schema? Lookup tables? 29.Can you perform logistic regression with Excel? (yes) How? (use linest on log-transformed data)? Would the result be good? (Excel has numerical issues, but it's very interactive) 30.Have you optimized code or algorithms for speed: in SQL, Perl, C++, Python etc. How, and by how much? 31.Is it better to spend 5 days developing a 90% accurate solution, or 10 days for 100% accuracy? Depends on the context? 32.Define: quality assurance, six sigma, design of experiments. Give examples of good and bad designs of experiments. 33.What are the drawbacks of general linear model? Are you familiar with alternatives (Lasso, ridge regression, boosted trees)? 34.Do you think 50 small decision trees are better than a large one? Why? 35.Is actuarial science not a branch of statistics (survival analysis)? If not, how so? 36.Give examples of data that does not have a Gaussian distribution, nor log-normal. Give examples of data that has a very chaotic distribution? 37.Why is mean square error a bad measure of model performance? What would you suggest instead? 38.How can you prove that one improvement you've brought to an algorithm is really an improvement over not doing anything? Are you familiar with A/B testing? 39.What is sensitivity analysis? Is it better to have low sensitivity (that is, great robustness) and low predictive power, or the other way around? How to perform good cross-validation? 40.Compare logistic regression w. decision trees, neural networks. How have these technologies been vastly improved over the last 15 years? 41.Do you know / used data reduction techniques other than PCA? What do you think of step-wise regression? What kind of step-wise techniques are you familiar with? When is full data better than reduced data or sample? 42.How would you build non parametric confidence intervals, e.g. for scores? (see the AnalyticBridge theorem) 43.Are you familiar either with extreme value theory, Monte Carlo simulations or mathematical statistics (or anything else) to correctly estimate the chance of a very rare event? 44.What is root cause analysis? How to identify a cause vs. a correlation? Give examples. 45.How would you define and measure the predictive power of a metric? 46.How to detect the best rule set for a fraud detection scoring technology? How do you deal with rule redundancy, rule discovery, and the combinatorial nature of the problem (for finding optimum rule set - the one with best predictive power)? Can an approximate solution to the rule set problem be OK? How would you find an OK approximate solution? How would you decide it is good enough and stop looking for a better one? 47.How to create a keyword taxonomy? 48.What is a Botnet? How can it be detected? 49.Any experience with using API's? Programming API's? Google or Amazon API's? AaaS (Analytics as a service)? 50.When is it better to write your own code than using a data science software package? 51.Which tools do you use for visualization? What do you think of Tableau? R? SAS? (for graphs). How to efficiently represent 5 dimension in a chart (or in a video)? 52.What is POC (proof of concept)? 53.What types of clients have you been working with: internal, external, sales / finance / marketing / IT people? Consulting experience? Dealing with vendors, including vendor selection and testing? 54.Are you familiar with software life cycle? With IT project life cycle - from gathering requests to maintenance? 55.What is a cron job? 56.Are you a lone coder? A production guy (developer)? Or a designer (architect)? 57.Is it better to have too many false positives, or too many false negatives? 58.Are you familiar with pricing optimization, price elasticity, inventory management, competitive intelligence? Give examples. 59.How does Zillow's algorithm work? (to estimate the value of any home in US) 60.How to detect bogus reviews, or bogus Facebook accounts used for bad purposes? 61.How would you create a new anonymous digital currency? 62.Have you ever thought about creating a startup? Around which idea / concept? 63.Do you think that typed login / password will disappear? How could they be replaced? 64.Have you used time series models? Cross-correlations with time lags? Correlograms? Spectral analysis? Signal processing and filtering techniques? In which context? 65.Which data scientists do you admire most? which startups? 66.How did you become interested in data science? 67.What is an efficiency curve? What are its drawbacks, and how can they be overcome? 68.What is a recommendation engine? How does it work? 69.What is an exact test? How and when can simulations help us when we do not use an exact test? 70.What do you think makes a good data scientist?