Tag Archives: big data

A Small Trick for Big Data in R

The other day I was writing a prediction script in R for a very large data set. I was data prepping and needed to create a logical vector from a numeric vector. I didn't want to spend the time loading … Continue reading

Posted in analysis, data, R | Tagged , , | Leave a comment

Using DPLYR in R: A Quicker, Easier Way to Work with Data

As I promised, I thought I would show an example using DPLYR. I decided to create my own data set, instead of going with a canned data set in R. I did this to preface my next few posts. After … Continue reading

Posted in analysis, data, R | Tagged , , , | Leave a comment

Fast Data Frame Modification in R

One of the frequent data structures I use in R is a data frame. Data frames are similar to matrices except they allow different types of variables in each column. I always rejoice when I can reduce the analysis at … Continue reading

Posted in analysis, data, R | Tagged , , , , | Leave a comment

Short Circuiting Logical Statements in R

Short circuiting logical statements are the way ‘lazy’ programming languages evaluate logical statements.  To identify whether or not the programming language you are using is lazy or eager, reference the chart on the wiki page: http://en.wikipedia.org/wiki/Short-circuit_evaluation The lazy (and quicker) … Continue reading

Posted in analysis, data, R | Tagged , | Leave a comment

Big Data Introduction

Happy Holidays! For the next few posts, I will be talking about using some tools/tricks on big data. I think that the term 'big data' gets thrown around a bit much these days. The more common definition of big data … Continue reading

Posted in analysis, data | Tagged , , | Leave a comment