Data Analysis as a Service
SpeakerGurvinder Singh
TrackTrack 3 --Lecture Hall IX on the First Floor
DescriptionIn recent years, the amount of research data generated has increased exponentially. So there has been an increasing demand of getting this data to work by storing and processing it in a horizontally scalable way. At UNINETT, we have large amount of data coming from different sources e.g. Netflow, System logs. To process such an amount of data, we require systems which can store data at high speed as well as offers capability to analyze incoming data. The system should be able to support real time analytics as well as batch analytics on historical data.
Considering such requirements, we are testing systems which can store and process data in a distributed and scalable manner. Currently we are looking into system such as Hadoop, Spark, Hbase and Graph processing system to store and process Netflow data. This talk will describe our experiences from such systems and using them to analyze Netflow data. The experiences will include advantages and drawbacks of different systems, their performance etc.
Considering such requirements, we are testing systems which can store and process data in a distributed and scalable manner. Currently we are looking into system such as Hadoop, Spark, Hbase and Graph processing system to store and process Netflow data. This talk will describe our experiences from such systems and using them to analyze Netflow data. The experiences will include advantages and drawbacks of different systems, their performance etc.
Presentation documents
All talks
- Introducing 100G Transmission & OTN in the Nordics
- "UH-sky" - A Community Cloud for the Norwegian Research and Education Community
- A Green ICT Maturity Model for Higher Education.
- Automatic Provisioning of Networking Resources in Foreign Domain
- Bring-your-own-device Exam System for Campuses
- Building a Distributed Cloud Storage System for Researchers is Not as Hard as You Think....Or is it?
- COmanage: Identity Management and Collaboration Services for Virtual Organizations
- Censoring Other People's Metadata
- Challenges and Opportunities Building a Wireless Campus Network
- Cloud-storage with Box.com on a Nordic Level - From Tenders to Implemented Services
- Cognitive OTP - Novel Technique to Establish Identity of a Person (Human) in Cyber Space
- Data Analysis as a Service
- Data Driven Wind Business
- Data Practices in the Solid Earth Science: An Example from Seismological Community
- Deploying Standards-based, Multi-domain Bandwidth-on-Demand Services
- Digital Assessment with Students' Own Device: Challenges and Solutions
- Digital Assessments, on Campus and Networks
- ERAI - EUNIS Research and Analysis Initiative
- Enlighten Your Research Global: An International Competition to Support Global Scientific Collaboration
- European Rosetta Mission to Comet 67P - A Challenge for Virtual Observatory Approach
- Fostering Aggregated Public Sector Procurement on a European Scale – The Legislation and Practical Application
- From NSI Demonstrations to Production Services: The NSI-CONTEST Conformance Test Suite
- Future Network Architectures
- GÉANT, Other e-Infrastructures and the Future Internet – Driving European Innovation
- GÉANT2020 - Towards the European Communications Commons
- How to Build Trust on the Internet
- How to Succeed in ISO 27001 Information Security Certification
- Hybrid Clouds and Open Source Technologies as Key to Competitive Differentiation
- Innovation Platform 2.0
- Invitation to NDN2016
- Large-scale Campus Wireless Networks: Development, Opportunities and Strategy
- Layer 1 Encryption in WDM Transport Systems
- MOOC as Disruptive Innovation
- Making Mobile Data Consumption Affordable for Higher Education Students in Netherlands, Portugal, Spain and Sweden.
- Managing Audio-Visual Cultural Data
- Managing Big Multidimensional Data - For Energy And Beyond
- Methods for Improving Multimedia Streaming Throughput to Mobile Nodes in Heterogeneous Wireless Environments
- Multi-Domain VPN, a New Network Service in Europe
- Nordic Collaboration on e-Infrastructures: Challenges and Opportunities
- Numbering All the Bones
- OPEX Savings Based on Energy Efficient Strategies in NREN Core Optical Networks
- Open Cloud Service Hubs
- Organising a Customer Survey - Case Funet
- Packet-Optical and SDN Evolution for Transport Agility
- Panel of Nordic NREN CEOs
- Panel of Video Experts
- People in Glass Houses Shouldn't Throw Stones
- SUNET eduID - An Open IdP for Higher Education in Sweden
- Secure Cloud Management
- Secure Data Storage and Sync Despite the Heartbleeds and Snowdens
- Shared Lecture Capture Services in Norwegian Higher Education
- Standing on Giants: The Relationship between Research Infrastructures with e-Infrastructures
- The Danish National Strategy on Data Management
- The Global Context for 2020
- The Missing Link - Obstacles to Global Integration
- UNINETT CBP activities
- UNINETT Feide Connect
- UNINETT's Network Monitoring Toolkit
- User Managed Access
- Using Commodity Hardware for Large Scale 10Gbps Passive Monitoring
- Videoconferencing Without the Worry - An NREN Service
- Web-RTC: A Proposed Roadmap for Higher Education & Research
- Welcome from SUNET
- Welcome to Uppsala University
- cryptech.is