563 research outputs found
Towards Higher Speed Next Generation Passive Optical Networks
No full textL'abstract è presente nell'allegato / the abstract is in the attachmen
MineDojo Internet Knowledge Base (Reddit)
No full textProject website: minedojo.org
Paper: arxiv.org/abs/2206.08853
GitHub: github.com/MineDojo/MineDojo
We collect 340K+ Reddit posts along with 6.6M comments under the “r/Minecraft” subreddit. These posts ask questions on how to solve certain tasks, showcase cool architectures and achievements in image/video snippets, and discuss general tips and tricks for players of all expertise levels. Large language models can be finetuned on our Reddit corpus to internalize Minecraft-specific concepts and develop sophisticated strategies.
Cite Us
@article{fan2022minedojo,
title = {MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge},
author = {Linxi Fan and Guanzhi Wang and Yunfan Jiang and Ajay Mandlekar and Yuncong Yang and Haoyi Zhu and Andrew Tang and De-An Huang and Yuke Zhu and Anima Anandkumar},
year = {2022},
journal = {arXiv preprint arXiv: Arxiv-2206.08853}
Current Trends towards PON systems at 50+ Gbps
No full textNext generation PON targeting 50 Gbit/s/lambda (50G-PON) based on intensity modulation and direct detection (IM-DD) will likely be under strong bandwidth limitations. We present a PAM-2 and Electrical DuoBinary performance analysis of 50 Gbps PON system by using 25G and 50G transceivers technology with several optical receiver architectures and study of the adaptive equalization impact
MineDojo Internet Knowledge Base (Wiki)
No full textProject website: minedojo.org
Paper: arxiv.org/abs/2206.08853
GitHub: github.com/MineDojo/MineDojo
The Minecraft Wiki pages cover almost every aspect of the game mechanics, and supply a rich source of unstructured knowledge in multimodal tables, recipes, illustrations, and step-by-step tutorials. We scrape 6,735 pages that interleave text, images, tables, and diagrams. To preserve the layout information, we also save the screenshots of entire pages and extract bounding boxes of the visual elements.
There are two files in our Wiki knowledge base.
wiki_samples.zip: A sample version of the full knowledge base (10 pages).
wiki_full.zip: The full knowledge base (6,735 pages).
Cite Us
@article{fan2022minedojo,
title = {MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge},
author = {Linxi Fan and Guanzhi Wang and Yunfan Jiang and Ajay Mandlekar and Yuncong Yang and Haoyi Zhu and Andrew Tang and De-An Huang and Yuke Zhu and Anima Anandkumar},
year = {2022},
journal = {arXiv preprint arXiv: Arxiv-2206.08853}
Optimization of band-limited DSP-aided 25 and 50 Gbps PON using 10G-class DML and APD
No full textThe increasing demand for network capacity is driving the development of next-generation high-speed Passive Optical Networks (PON) supporting 25 and 50 Gbps. One solution to reduce transceiver cost is reusing the 10G-class optical transmitter (including Directly Modulated Lasers, DML, in O-band) and receiver components in combination with Digital Signal Processing (DSP) techniques to compensate for bandwidth limitations. In this paper, by means of both a set of laboratory experiments and a metropolitan field demonstrator, we discuss practical PON solutions at 25 and 50 Gbps per wavelength and per direction. In terms of modulation formats, we compare 2-level pulse amplitude modulation (PAM-2), 4-level PAM (PAM-4) and electrical duobinary (EDB) modulation formats, with feed-forward (FFE) and decision-feedback (DFE) adaptive equalizer at the receiver side. The novelty of our paper is manifold. First, we present an optimization in terms of optical receiver band requirements for the 50 Gbps transmission.We show, by means of experimental measurements and numerical simulations, the minimum required bandwidth for DML laser and APD receiver (with appropriate DSP techniques) to realize next generation 25 and 50 Gbps PON transceivers. Second, we discuss also the upstream point of view, with a specific focus on DSP, and in particular, we propose an experimental solution based on a burst mode receiver with memory-aided DSP technique, together with a novel DSP approach to overcome the typical AC coupling distortion due to the burst mode scenario. Finally, we show a coexistence experiment between XGS-PON and 25 Gbps PON on an installed metropolitan field trial
Opportunities and challenges when using low bandwidth optics for higher capacity PON systems
No full textNext generation PON physical layer, targeting 50 Gbit/s/lambda, has to deal with optoelectronics bandwidth limitation. In this invited paper, we review the resulting required bandwidths and discuss the trade-off between receivers with or without equalization
When search engine services meet large language models: visions and challenges
No full textCombining Large Language Models (LLMs) with search engine services marks a significant shift in the field of services computing, opening up new possibilities to enhance how we search for and retrieve information, understand content, and interact with internet services. This paper conducts an in-depth examination of how integrating LLMs with search engines can mutually benefit both technologies. We focus on two main areas: using search engines to improve LLMs (Search4LLM) and enhancing search engine functions using LLMs (LLM4Search). For Search4LLM, we investigate how search engines can provide diverse high-quality datasets for pre-training of LLMs, how they can use the most relevant documents to help LLMs learn to answer queries more accurately, how training LLMs with Learning-To-Rank (LTR) tasks can enhance their ability to respond with greater precision, and how incorporating recent search results can make LLM-generated content more accurate and current. In terms of LLM4Search, we examine how LLMs can be used to summarize content for better indexing by search engines, improve query outcomes through optimization, enhance the ranking of search results by analyzing document relevance, and help in annotating data for learning-to-rank tasks in various learning contexts. However, this promising integration comes with its challenges, which include addressing potential biases and ethical issues in training models, managing the computational and other costs of incorporating LLMs into search services, and continuously updating LLM training with the ever-changing web content. We discuss these challenges and chart out required research directions to address them. We also discuss broader implications for service computing, such as scalability, privacy concerns, and the need to adapt search engine architectures for these advanced models
Field demonstration of 25G-PON and XGS-PON burst-mode upstream coexistence
No full textWe perform a field demonstration of 25 Gb/s burst-mode upstream duobinary transmission in O-band using 10G optoelectronics and APD-based optical receiver with memory-aided adaptive equalization, coexisting with XGS-PON transmission. We achieve 31 dB ODN loss budget and show marginal interference penalty between the two systems
Towards 50 Gb/s in High-Speed PON: Optimization of Modulation Formats Using Pre-Chirping
No full textHigh-Speed (HS) Passive Optical Network (PON) alternatives with single-wavelength capacity higher than 10 Gb/s, such as 25 and 50 Gb/s, are currently under investigation, development and standardization. Modulation formats based on intensity modulation and direct detection (IM-DD) have been preferred to implement next generation HS-PON due to their advantages in terms of complexity and cost. Among them, conventional Binary Pulse Amplitude Modulation (PAM-2) format, as well as Quaternary PAM (PAM-4) and Electrical Duo-Binary (EDB), have been emerged as the most widely employed. In previous works, we have shown that any of these formats is feasible for the transmission of 50 Gb/s using currently available 25 Gb/s technology when operating in C-band of single mode fibre (SMF) for typical PON distances (i.e., 20 km). In this contribution, we introduce the use of pre-chirping technique in order to overcome this reach limitation. We compare the achievable performance of PAM-2, PAM-4 and EDB under demanding bandlimited and dispersive conditions on the transmission of 50 Gb/s using adaptive equalization, with and without pre-chirping. By means of simulations, we demonstrate that using pre-chirping enables the operation of PAM-2 and PAM-4 on the transmission of 50 Gb/s through 20-km of SMF in O- and C-band, respectively, using currently available technology
Sampling sparse representations with randomized measurement langevin dynamics
No full textStochastic Gradient Langevin Dynamics (SGLD) have been widely used for Bayesian sampling from certain probability distributions, incorporating derivatives of the log-posterior. With the derivative evaluation of the log-posterior distribution, SGLD methods generate samples from the distribution through performing as a thermostats dynamics that traverses over gradient flows of the log-posterior with certainly controllable perturbation. Even when the density is not known, existing solutions still can first learn the kernel density models from the given datasets, then produce new samples using the SGLD over the kernel density derivatives. In this work, instead of exploring new samples from kernel spaces, a novel SGLD sampler, namely, Randomized Measurement Langevin Dynamics (RMLD) is proposed to sample the high-dimensional sparse representations from the spectral domain of a given dataset.Specifically, given a random measurement matrix for sparse coding, RMLD first derives a novel likelihood evaluator of the probability distribution from the loss function of LASSO, then samples from the high-dimensional distribution using stochastic Langevin dynamics with derivatives of the logarithm likelihood and Metropolis–Hastings sampling. In addition, new samples in low-dimensional measuring spaces can be regenerated using the sampled high-dimensional vectors and the measurement matrix. The algorithm analysis shows that RMLD indeed projects a given dataset into a high-dimensional Gaussian distribution with Laplacian prior, then draw new sparse representation from the dataset through performing SGLD over the distribution. Extensive experiments have been conducted to evaluate the proposed algorithm using real-world datasets. The performance comparisons on three real-world applications demonstrate the superior performance of RMLD beyond baseline methods
- …
