Talk given by Prof. Heather Zheng: Network Design for Big-Data
MSRA平时的talk和seminars非常多,之前听了若干,但回来之后都没怎么整理,全废了T_T
以后争取每次都能整理下,加深印象。虽然我的笔记质量不高,只有自己能看懂~
————————————我是分割线——————————
Talk: Network Design for Big-Data
Speaker: Prof. Heather Zheng, U. C. Santa Barbara.
Time: 11:00AM, December 6, Thursday
Venue: Demo Room (14366, 14F)
讲座两个部分,第一部分是用flexible wireless进行data center通信建设;第二部分是scalable social network analysis 社交网络计算。
Part1.Network Design for Big-Data
traffic hotspots
- unpredictable
- double fee
Wireless links-flexible
challenge #1 Link Blockage
3D Beamforming,这里有个图:
- 用天花板Reflector进行反射
- 接收器下面用Absorberx吸收信号,防止再反射
challenge #2 Interference Footprint
challenge #3 Robustness ti Alignment Error
concurrency
总结:
因为我不懂无线传感网络方面的知识,所以这个talk的细节不是太懂,不过用天花板反射倒是理解了,很巧妙的思路~
————————————我是分割线——————————
Part2.enable scalable graph processing for today’s massive online social networks
distance ranked social
rank search result based on social distance
Key Limition Today:Scale
A drastically different alternative
- O(1) query time
- Parallelize
Graph embedding
Approach for Embedding
require:
- BFS
- converge quickly
- optimize accuracy
shortest path search
说了一个算法,说得太快,没听清T_T
Rigel 12倍于 Sketch Tree
总结
具体算法没听懂,但我知道了这个东西:
1. 社交网络对人名的搜索可以借助预处理来给出一个很好的结果,比尔搜索Bob,可以找到你可能认识的Bob,而人人网找人搜索很烂,几乎不能按好友数排序。
1. 社交网络计算量很大,有很多算法值得探究~
1. 做社交网络不容易,人人的研发能力不足以提供完美的服务
————————————我是分割线——————————
附:
Abstract:
The arrival of big-data applications has created significant challenges to network design. For example, batched data processing jobs are straining network capacity in data center networks, causing unexpected outages and service downtimes, while social network companies struggle to manage millions of users and billions of user events and queries in real time. In both cases, network architects must find new, novel ways to support traffic/service demands that display complex structure and vary significantly with time.
In this talk, I will discuss two of our recent works on big-data.
- First, I will talk about challenges in dealing with dynamic traffic hotspots in data centers, and our solution using flexible wireless interconnects to augment wired connections. We propose 3D beamforming 60GHz links that leverage ceiling reflection to overcome key challenges in deploying wireless links, creating parallel wireless links connecting any racks at wired data rates.
- Next, I will discuss our effort to enable scalable graph processing for today’s massive online social networks. We propose graph coordinate systems, a new approach that accurately approximates node distances in constant time by embedding graphs into coordinate spaces. Our design not only provides accurate results for massive graphs (43 million nodes), but also is naturally parallelizable across computer clusters. It answers node-distance queries in 10’s of microsecond, and produces shortest path results up to 18 times faster than prior solutions with similar accuracy.
- Finally, I will conclude with a brief summary of other ongoing projects.
Bio:
Haitao (Heather) Zheng is currently an Associate Professor at the Computer Science department, U. C. Santa Barbara. She completed her M.S. and Ph.D. degrees in Electrical and Computer Engineering at Univ. of Maryland, College Park (1998, 1999) and her B. S. degree from Xi’an Jiaotong University (gifted class). She is a recipient of the MIT Technology Review’s TR-35 Award (Young Innovators Under 35) and the World Technology Network Fellow Award. Her work has been covered by media outlets such as New York Times, Boston Globe, MIT Technology Review, and Computer World. Her work on cognitive radios was named as the top-10 Emerging Technologies by MIT Technology Review in 2006. Her research spans areas of wireless networking, distributed systems, economics, data-intensive computing, and social networks.