How to Extract Comments from Twitter (Using R)

It is possible to extract tweets about your company or a competitor on twitter using an R package called twitteR. Once you load this package, you can use the following commands to extract and archive tweets every day:

company.tweets = searchTwitter(‘@[your_screen_name_or_competitor]’,sinceID=[last_ID_extracted])
 df <- do.call(“rbind”, lapply(company.tweets, as.data.frame))
 write.csv(df,file=”c:\\[your_file].txt”)

How to Extract Likes and Comments from Facebook (Using R)

Below list of commands facilitate extracting number of likes and talks for any given company from Facebook.com using R which can be automated with an end-of-day process and build up trend charts comparing your likes against competitors:

require(RCurl)
require(rjson)
data <- getURL(“http://graph.facebook.com/%5Byour_company_or_competitor%5D/&#8221;)
feed <- fromJSON(data)
df<-data.frame(created=Sys.date(),likes=feed$likes,talks=feed$talking_about_count,stringsAsFactors=FALSE)
 write.csv(df,file=”c:\\[your_file].txt”)

And, below sniplet extracts list of all comments, about your company or your competitor into a nice formatted text file:

data <- getURL( “https://graph.facebook.com/%5Byour_company_or_competitor%5D/feed?limit=%5Ba_max_value%5D&access_token=%5Byour_token%5D&#8221; )
feed <- fromJSON(data)
N<-length(feed$data)
def<-data.frame(id=rep(0,N), name=rep(“”,N), created=rep(“”,N), likes = rep(0,N), message=rep(“”,N),stringsAsFactors=FALSE)
for(e in 1:N) {
def$id[e] <- feed$data[[e]]$from$id
def$name[e] <- feed$data[[e]]$from$name
def$created[e] <- feed$data[[e]]$created_time
if (is.null(feed$data[[e]]$likes) == FALSE) def$likes[e] <- feed$data[[e]]$likes$count
if (is.null(feed$data[[e]]$message) == FALSE) def$message[e] <- feed$data[[e]]$message
}
write.csv(def,file=”c:\\[your_file_2].txt”)

Please note that this extraction requires an access_token which can be received from developers.facebook.com.

Business Intelligence as a Service Providers

List of some leading BIaaS providers:

Industry Specific Providers:

Tool Specific Providers:

Platform Providers:

  • 1010data: Provides cloud-based platform for BI
  • MyDials: Provides cloud-based platform for BI
  • YurBI: Provides cloud-based platform for BI
  • DecisiveBI: Provides cloud-based platform for BI
  • Birst: Provides cloud-based platform for BI
  • GoodData: Provides cloud-based platform for BI
  • Bime: Provides cloud-based platform for BI

More to come soon…

DWH Solutions

Summarized compilation of highlights about leading DWH solutions:

Teradata

  • “Teradata offers the most scalable, … cloud-capable EDW solution in today’s market…” (Forrester)
  • “…most satisfied by the technology scalability, stability, predictability of performance, mixed workload capabilities…” (Gartner)
  • “…very strong set of db features in availability, security, performance, administration, data types and integration…” (Forrester)
  • “…who need the best in high availability or scale should look first at Oracle…” (Forrester)
  • “…the product is highly stable, consistently meets the performance requirements…“
  • “Potential Game Changer – With 2012, more competitive…BI improvements enabled users to get their own data easily.” (IDC)
  • “…one of the best value propositions…low cost…highly favorable price/performance…dominant in midsize DWH” (Gartner)
  • “…SQL Server based EDWs well beyond tens of terabytes into a peta-byte scale…” (Forrester)
  • “…best-of-breed real-time analytics solution portfolio that incorporates mature columnar database technology…” (Forrester)
  • “…query processing is extremely fast with no optimization necessary…compression can reach up to 10 times…” (Gartner)
  • “…supporting workloads of reporting, ad hoc query, OLAP, in-DB analytics, batch ETL, real-time decision support…” (Forrester)
  • “…partitioning, compression and reduced administrative hours support optimized performance…” (Gartner)

ETL Solutions

Summarized compilation of highlights about leading ETL solutions:

Informatica

  • “…offers the most comprehensive ETL solution to support any requirement” (Forrester)
  • “…extremely wide variety of data sources and targets” (Gartner)

IBM InfoSphere

  • “…extensive metadata discovery, modeling and metadata management functionality” (Gartner)
  • “…has strong integration options and runtime capabilities” (Forrester)

Business Objects

  • “…enhanced metadata and profiling capabilities…  tight integration with BO Business Intelligence Platform” (Gartner)
  • “…heavily optimized for DW and BI initiatives” (Forrester)

Ab Initio

  • “…the only vendor we evaluated that has seamlessly integrated a business rules engine with its ETL capabilities” (Forrester)
  • “…a high-end data integration and real-time, transactional, and batch transaction processing requirements” (Forrester)

SAS

  • “…SAS’s ETL adoption continues to remain primarily within its SAS Business Intelligence and SAS Analytics installed base” (Forrester)
  • “…SAS’s long history as an innovator of analytic applications and technology to capture opportunities” (Gartner)

Oracle Data Integrator

  • “…enterprise ETL offering optimized for Oracle databases” (Forrester)
  • “…the reasonable learning curve… Oracle as a “one-stop shop” for all their potential data integration functionality needs” (Gartner)

Talend

  • “…low prices relative to most competitors are a big factor…ease of use and speed of deployment as strengths…custom transformation logic using Java” (Gartner)

Reporting Solutions

Summarized compilation of highlights about leading reporting solutions:

Cognos

  • “IBM is the only vendor that can provide one stop shopping for BI platform & tools (HW, SW, apps, office apps)…” (Forrester)
  • “The company takes a holistic approach to what it calls Business Analytics and Optimization…“ (Gartner)

Business Objects

  • “Best BI tool for each job…BO Explorer – OLAP with strong UI..Xcelsius – self contained flash files” (Forrester)
  • “…corporate standards and integration with enterprise applications” (Gartner)

Microsoft SQL Server BI

  • “…a unique pervasive advantage from SharePoint and Office products…hard to beat pricewise…” (Forrester)
  • “…compelling license-cost value proposition…move seamlessly from a personal workbook to enterprise data source” (Gartner)

Oracle BI

  • “…ability to define actions and execute processes right from BI metadata across BI and ERP applications…” (Forrester)
  • “…functionality, enterprise application integration, and data access capabilities” (Gartner)

Microstrategy

  • “…ROLAP engine brings processing power, scalability & potentially lower long-term TCO with less reports & marts” (Forrester)
  • “…functionality, performance and support for large data…parameterized, object-oriented report development…“ (Gartner)

QlikView

  • “…can claim the best memory optimization and compression” (Forrester)
  • “…a wholly in-memory data store…intuitive and likable…” (Gartner)

Dundas Dashboard

  • “…able to quickly implement visualizations that allow business managers to analyze the root causes…” (Aberdeen)
  • “…provides developers with the components needed for implementing advanced data visualization…” (Aberdeen)