64 research outputs found

    Investigating MapReduce framework extensions for efficient processing of geographically scattered datasets

    No full text
    We observe two important trends brought about by the evolution of Internet in recent years. Firstly to improve end-to-end application performance in presence of bottlenecks in the wide-area Internet communication, modern day Internet services are designed in a decentralized fashion involving geographically distributed data-centers connected through the Internet. Secondly the pervasive nature of Internet services has resulted into an exponential growth in the size of digital information created, captured or replicated. Organizations are keenly interested in mining this information to uncover trends, statistics and other actionable information which can give them competitive advantage. These two trends necessitate the design of a large-scale data processing system which can operate efficiently in a distributed environment involving multiple datacenters connected through the Internet. In recent years, MapReduce programming model and specifically its open source implementation Hadoop is gaining a lot of traction for performing large-scale data processing in a centralized environment. Our evaluation of different real-world usage scenarios of Hadoop deployments revealed that the organizations with the distributed datasets are required to copy the entire dataset to a centralized location so that it can be efficiently processed by the Hadoop MapReduce framework. As the Internet evolves growth in the size of distributed datasets would outpace the improvements in the network bandwidth available in the Internet. At that point the approach of copying the entire dataset to a single location using Internet would become infeasible. In this thesis, we have investigated the possibility of extending the MapReduce and specifically Hadoop framework to operate in a distributed environment involving multiple datacenters connected through the Internet. We also have proposed policies to improve the performance of Hadoop MapReduce framework in a distributed environment. We have observed that our policies improve the performance of Hadoop framework substantially.M.S.Includes bibliographical referencesby Hrishikesh Gadr

    Framework for crawling and local event detection using twitter data

    No full text
    Twitter is a popular social media service, with millions of registered users as of December 2010. Twitter hosts substantial amounts of user-contributed data of real-world events. Twitter‟s core functions represent a simple social awareness stream model. Twitter users share information about upcoming events, the events the users are attending and events being broadcasted. The users also specify their location in their profile on Twitter. We can programmatically collect data from Twitter using their API and detect top terms and events in the data. Researchers can use this program to collect any kind of data from social networks easily. Journalists can get a real time the list of events detected by this method. In this thesis, we propose a solution to tackle the problem above. We wrote scripts that collected Twitter data through Twitter API. The scripts collect data according to user location and by search keywords. We built a web interface that provides mechanism to manage the collection of data. The web interface allows addition of new locations and keywords to the data collection. We collected Twitter data for important locations across the United States of America and the world using these tools. We use two approaches to detect trends in the data. In the first approach, we detected spikes in data by looking at overall rate of tweets at each location over a period of time. In the second approach, .we indexed the data according to location and time of the day. Then, we identified trends in the indexed data by ranking the terms according to spikes in term frequency. Using our framework, we can detect the top events and trends for a given time period and location according to Twitter data.M.S.Includes bibliographical referencesby Hrishikesh Baksh

    Geochemistry of Deccan Tholeiite Flows and Dykes of Elephanta Island: Insights into the Stratigraphy and Structure of the Panvel Flexure Zone, Western Indian Rifted Margin

    No full text
    Elephanta Island near Mumbai is an important area for understanding the stratigraphic and structural framework of the Deccan flood basalt province in the tectonically disturbed Panvel flexure zone on the western Indian rifted margin. Elephanta exposes a west-dipping, 66–65 Ma sequence of tholeiitic lava flows and dykes. Geochemical correlations with the thick, horizontal, 66–65 Ma Western Ghats sequence to the east show that lava flows of the Khandala and Ambenali formations are present at Elephanta, with two lava flows probably being locally derived. The Elephanta tholeiites have experienced crystal fractionation and accumulation, particularly of olivine. They have εNd(t) ranging from +5.4 to −7.9 and (87Sr/86Sr)t from 0.70391 to 0.70784, with most tholeiites little contaminated by continental lithosphere, probably lower crust. Field and geochemical data indicate a normal fault along the central part of Elephanta with a 220 m downthrow, consistent with a domino-type block-faulted structure of Elephanta, and the surrounding area as previously known. Seventeen of the 20 analyzed Elephanta intrusions, striking ~N–S, belong to the Coastal dyke swarm of the western Deccan province. Several of these are probable feeders to the Ambenali Formation in the Western Ghats sequence, requiring reconsideration of the current view that the voluminous Wai Subgroup lavas of the Western Ghats were erupted without organized crustal extension. East–west-directed extensional strain was already active at 66–65 Ma along this future (62.5 Ma) rifted continental margin. A young (~62 Ma) ankaramite dyke on Elephanta Island is a probable feeder to the Powai ankaramite flow in the 62.5 Ma Mumbai sequence 20 km to the northwest

    Management of Fish Bone-Induced Liver Abscess with Foreign Body Left In Situ

    No full text
    Pyogenic liver abscess, having experienced an evolving pathogenesis over the years, still remains a serious problem with significant morbidity. Iatrogenic and ascending biliary infections are the most common known etiologies for hepatic abscess. Here we report an interesting case of an elderly lady admitted with abdominal pain due to a pyogenic liver abscess in the left liver lobe which was attributed to perforation by an ingested fish bone. The authors also reviewed literature for management for this rare case as there are no standard guidelines. Our patient was successfully treated with antibiotics and percutaneous drainage with foreign body left in situ
    corecore