The goal of the DUST workshop series is to bring together researchers, operators, and analysts interested in unsolicited traffic analysis, especially traffic destined to unassigned (dark) IP address space.

In this workshop we discussed the STARDUST project, potential future use and evolution of the STARDUST architecture and tools, as well as research and other infrastructure related to unsolicited Internet traffic.

The goals of this workshop are to identify critical research questions that warrant a call for network measurement (broadly defined), identify barriers and facilitators of that research, and discuss how research results can have impact beyond the research community.

This workshop is a follow-up to the WOMBIR 2021 workshop in January. Our goal is to provide recommendations to NSF that can help overcome barriers related to measurement of Internet infrastructure. The first workshop had broad topics based on submitted white papers. In this second workshop we will go deeper into specific subjects, and generate text on those subjects that will contribute to the final report.

Initial topics:

• economics and incentives surrounding abuse of the Internet addressing, naming, and routing systems,
• aspects of internet structure that allow us to establish a baseline against which to detect evidence of abuse, including DNS zone delegation, DNS and BGP trust hierarchies, and routing relationships
• what data is available that can inform these topics, and how to think about what needs to be ‘open knowledge’ in order to allow the public and private sector to cooperatively understand and improve security and stability of these systems.
• we will also discuss what kind of institutional, community, and government support do we need to get something off the ground, and
• discuss what we can learn from similar challenges in other critical infrastructure industries, e.g., financial.

The goal of the DUST workshop series is to bring together researchers, operators, and analysts interested in unsolicited traffic analysis, especially traffic destined to unassigned (dark) IP address space.

In this workshop we will introduce the STARDUST project and the developing state of the STARDUST architecture, as well as discuss future directions in consideration of the needs and requirements for prospective users.

CAIDA hosts annual Active Internet Measurement Systems (AIMS) workshops to promote discussion between academics, industry, policymakers, and funding agencies on active Internet measurement, exchange of research ideas and questions that have been answered, or could be answered, with proposed measurement infrastructures.

This year we will not limit talks to active measurements, e.g., I am interested in exploring with folks what can be done with passive measurements from the home to help inform questions like “how much traffic goes further than one AS hop away?”, and “what measurements should be sustained over time for research and informing-policy purposes?”.

The goal of this workshop series is to provide a forum for researchers, commercial Internet facilities and service providers, technologists, economists, theorists, policy makers, and other stakeholders to empirically inform emerging Internet regulatory and policy debates.

This year’s focus is the measurement and analysis of progress toward a given Internet policy goal.

For this AIMS, the focus of the workshop again will be on interaction and coordination between different existing measurement infrastructures. Topics of interest:

• Measurements that can address current or future public policy needs
• Infrastructure sharing
• Infrastructure development issues
• Data access and sharing
• Future measurement infrastructure architectures

The goal of this workshop series is to provide a forum for researchers, commercial Internet facilities and service providers, technologists, economists, theorists, policy makers, and other stakeholders to empirically inform emerging Internet regulatory and policy debates. Topics of interest:

• What do we know about the economics of the Internet ecosystem?
• What should a new Telecommunications Act look like?
• What data is needed in order to understand the state of the Internet and its future trajectory?

IMAPS is a workshop on interdisciplinary research of political events that affect the Internet and/or are partially visible through analysis of Internet measurement data.

The theme of IMAPS this year is Conflict and Contention in the Digital Age.

This year the focus of the workshop again will be on interaction and coordination between different existing measurement infrastructures. Topics of interest:

• Measurements that can address current or future public policy needs
• Infrastructure sharing
• Infrastructure development issues
• Data access and sharing
• Future measurement infrastructure architectures

Additionally, we intend to devote some time to reviewing the recommendations dealing with the following five themes:

• Data and infrastructure building blocks
• Promoting synergies among industry, government, researchers, vendors, Internet service providers
• Path measurement research
• Quality of experience measurement research
• Network architecture research

Topics of interest:

• What data is needed in order to understand the state of the Internet and its future trajectory?
• What do we know about the economics of the ecosystem?
• Architectural issues (anchored in current policy issues)
• Framing discourse around policy issues: is new language needed?
• Thought experiment: What would a new telecommunications act look like?

This year the focus of the workshop will be on interaction and coordination between different existing measurement infrastructures.

Topics of interest:

• Measurements that can address current or future public policy needs
• Infrastructure sharing
• Infrastructure development issues
• Data access and sharing
• Experimental design
• Future measurement infrastructure architectures

Both current events and trends, as well as our past discussions, shape the themes for this year’s WIE. The FCC’s latest open Internet order changes the landscape of regulation by using Title II as a basis for Internet regulation. We prefer not to use this workshop to debate what the court will do. Instead, we hope to discuss issues that will arise if the courts uphold the law. What are the implications of Title II regulation for some of the issues we have looked at in the past, or which are now emerging as important factors in shaping the future of the Internet?

• Quality of Experience
• Differentiated services on the public Internet
• Consumer expectations about broadband Internet access
• Implications of direct interconnection
• The implications of specialized services
• Measurement issues in February 2015 Open Internet Report and Order
• Implications of new technology

We have picked some specific topics for this meeting, based on the interests of the participants and a sense of what is important right now, but we want as well to see if we can take a fundamental look at the issues that may shape the future.

The discussions of this workshop tend to center on means–for example, how could one craft a network neutrality regulation. But neutrality is not a fundamental goal, it is a tool to prevent a set of harms. Understanding what these harms are is a better starting point for a long-range discussion.

This year, we want to explore existing capabilities and potential opportunities for network measurement in the wireless domain, and research infrastructure to support it. One motivation is the increasing attention to measuring the character of broadband access, including the U.S. FCC Measuring Broadband America effort (for both wireline and wireless connectivity). The more complex structure of cellular access, with its signalling protocols and potential to shape different sorts of application traffic, makes it harder to decide what to measure in order to characterize or compare wireless service.

Our goals for this two day workshop are: (1) to understand the wireless research infrastructure landscape(s), and measurement capabilities that support (or should support) it; (2) to determine what are the important questions that measurement can help answer who will be the customer for the measurements; and (3) to propose a vision/roadmap for wireless measurement research infrastructure and activities for the next decade.

This workshop is anchored around the theme of “ethics-by-design”, and aims to:

• Educate participants about underlying ethics principles and applications;
• Discuss ethical frameworks and how they are applied across the various stakeholders and respective communities who are involved;
• Impart recommendations about how ethical frameworks can be used to inform policymakers in evaluating the ethical underpinning of critical policy decisions;
• Explore cybersecurity research ethics techniques, tools, standards and practices so researchers can apply ethical principles within their research methodologies; and
• Discuss specific case vignettes and explore the ethical implications of common research acts and omissions.

Topics of discussion:

• Introduction to SIE and NMSG (Concepts, Toolkit, Methods, and Design needed to create your own security data redistribution network)
• Demos and tutorials on how to implement Passive DNS Replication sensor, darknet sensors, spam sensors
• Case studies of SIE data and DNSDB usage (research and operational)

The goal of the DUST workshop series is to bring together researchers, operators, and analysts interested in unsolicited traffic analysis, especially traffic destined to unassigned (dark) IP address space.

IP darkspaces are global routable address spaces that contain no active hosts. All traffic to an IP darkspace is unsolicited and unidirectional. Observing and analyzing darkspace traffic has helped detect and analyze global incidents such as scannning, DDoS attacks, network outages and misconfigurations.

Topics of interest for this workshop series include the economic drivers and effects of:

• peering strategies and conflicts
• Internet content delivery, including video
• the network neutrality debate
• Internet access competition, both wired and wireless
• BGP routing (e.g., how much does deaggregation cost?)
• IP transit pricing
• traffic and topology dynamics of the peering ecosystem

Common themes of the discussions included:

• Research Needs
• Darkspace Operations
• Technology Applications
• Data Sharing and Community Building

Topics of discussion:

• reviewing objectives, plans and results of various active measurement projects;
• identifying measurement priorities, strengths, and weaknesses of measurement efforts
• introducing IRNC participants to range of active measurement research activities, and exchange views on operational and research measurement needs
• exploring how active measurement can support existing and planned security research projects
• geolocation database accuracy and evaluation methods
• fostering collaboration, coordination, and data sharing among participants

The Network Geometry workshop focused on the following topics:

• Modeling the evolution of complex networks using hyperbolic geometry.
• Discovering hidden metric spaces in bipartite networks.
• Hidden metric spaces in biological and social networks.
• Construction of time-efficient algorithms for embedding large networks into metric spaces.

Topics of discussion:

• reviewing priorities/objectives/plans of various active measurement infrastructures, especially aimed at macroscopic security, stability, and performance measurements
• coordination among measurement infrastructures
• approaches to sharing data from measurement infrastructures
• geolocation bakeoff – designing an experiment to compare geolocation tools/services

Topics of discussion:

• Economics of address markets and of future designs/architectures
• Economics of peering and ISP interconnetion and the role of content

This workshop sought to define priority directions of various active measurement infrastructures especially aimed at macroscopic security, stability, and performance measurements. Topics of specific interest included:

• priorities/objectives/plans of various active measurement infrastructures
• clarifying academic, commercial, and government needs for active measurement data
• data sharing issues
• possible improvements in coordination of measurements across different (academic and non-academic) active measurement infrastructures

The focus of this workshop was on:

• Review of current DNS-related research
• Tutorial on DLV
• Topical issues in DNS Operations
• OARC update session

CAIDA and Cisco launched a new initiative to peer community and municipal networks utilizing national and regional fiber backbones.

The COMMONS Project is a collaboration that provides a platform for Internet researchers to study this critical infrastructure as well as a low-cost medium for networks to peer with one-another.

The focus of this workshop was on:

• DNS-related Internet measurements and research
• Operational co-ordination and trusted communication
• between root, TLD and other DNS and Internet operators
• Future evolution and governance of OARC

Internet research critically depends on measurement, but effective Internet measurement raises some big issues. There is increasing awareness that the size and scope of the Internet calls for large scale distributed network measurement. However to be viable, large scale measurement must overcome a number of challenges. Passive measurement raises significant privacy issues. And active measurement raises serious concerns about network impact.

This workshop will bring together key members of the Internet measurement community in an attempt to explore a community-oriented approach to these problems.

Topics of discussion:

• Monitoring nameserver response time
• Analysis of DNS anomalies
• Nameserver placement and “best server selection” problem
• New features in the DNS

CAIDA and the Lorentz Center co-hosted an Internet Statistics and Metrics Analysis workshop concerning the multiresolution analysis of core routing tables and macroscopic topology data sets. Research Topics:

• Inference of global Internet topology changes, routing policies,and routing behavior propagation, using BGP data as well as passive measurements.
• Anomalies within Internet address space and BGP behavior (flaps, holes, unallocated but announced IP space, AS-distributions).
• BGP convergence and scalability.
• Co-relation between path failures and BGP events which can help in characterizing redundancy among service providers.
• A comparative analysis of timing and content characteristics of global prefix attribute changes.
• Observations on traffic flow patterns and routing policies.
• Estimation of intra-AS demands (traffic matrix) and traffic dynamics at different timescales.
• Status reports of the RIPE NCC measurement infrastructure.

Meeting goals:

1. More detailed discussion of various telescope data use cases
2. Telescope data use in conjunction with DNS research

•  Meeting Minutes (Authentication required)

Topics of discussion:

1. How to sustain the UCSD telescope instrumentation
2. What is the most effective way for community to benefit from the value of the UCSD Network Telescope
3. Next steps to implement recommendations

Participants discussed the value of CAIDA telescope data, why it is important, and opportunities to improve ease of access

Participants discussed their darknet data needs.

•  Meeting Minutes (Authentication required)

The goal of the meeting was to discuss BGP measurement efforts and collected metadata.

Topics of discussion:

1. Status of the Routeviews project
2. bgp.tools platform
3. How to run safe and ethical BGP experiments

•  Meeting Minutes (Authentication required)

•  Meeting Minutes (Authentication required)

Topics of discussion:

1. How does CAIDA’s data help you do something you could not do otherwise?
2. What would be the most valuable thing CAIDA could do - regarding its telescope data - to help your company/your research

•  Meeting Minutes (Authentication required)

The goal of the meeting was to discuss BGP measurement efforts and collected metadata. This series of meetings is supported by two new CAIDA projects that seek to advance the state of BGP measurement: (1) CCRI ILANDS – creating new instrumentation to enable research combining traffic+BGP data (5-year NSF-funded project), and lower barriers to scientific research using both types of data; (2) NSF MSRI GMI3S – what data, tools and capabilities are needed to accelerate scientific research of Internet infrastructure security problems.

Topic of discussion: Review existing data available, with focus on BGP:

1. RouteViews update from UOregon
2. BMP vs BGP use (openbmp, gobmp)

•  Meeting Minutes (Authentication required)

Topics of Discussion:

1. Update on UCSD telescope STARDUST project status
2. UCSD telescope data users
   1. Merit: comparing lenses ISI: open list of scanners project
   2. MIT: hypersparse traffic matrix analysis project
   3. Hamburg: next steps on Spoki project
3. Other projects/topics
   1. Update on Wisc/FABRIC distributed telescope project
   2. Kentik: camprison of darknet sources to IBR sources on commercial links
   3. Brainstorm on traffic/statistics sharing approaches

•  Meeting Minutes (Authentication required)

• Related work

Meeting goals:

• Document (and publish) common view of the DDoS landscape: trends in attack levels and methods

Topics of discussion:

• Can the research community help confirm impact of industry initiatives with independent measurements?
• Sustaining such mitigations, which requires sustaining measurements to verify effectiveness of mitigations
• Can we compare results of different data sets, and explain discrepancies based on data sources, vantage points, methods, parameters?
• Can we create framework for reproducibility/repeatability of analysis by independent parties while safeguarding privacy interests?

Meeting goals:

• Determine call cadence
• Paper outline
• Determine contributors and contributions

Meeting goals:

• Discuss roles of BGP data in GMI Implementation Phase
• Discuss future sustainability models for RouteViews
• Discuss synergies between RouteViews and CAIDA

Meeting goals:

• Acquaint everyone with GMI Goals: Enable Improvements to Internet Infrastructure Security Through measurement.
• Identify/describe all of the measurement platforms/capabilities considered in GMI Design effort

Meeting goals:

• Review Year 2 GMI3S progress, Project Execution Plan for Year 3
• Other discussion topics:
  • ARDC collaborations
  • Announcing 240/4 parts
  • GMI-DDOS paper
  • Telescope maintenance
  • Present and Future of 5G ecosystem

Meeting goals:

• Review Year 3 GMI3S progress and discuss the different measurement infrastructures in place moving onto the Implementation phase of the project next year.

Held the day after IMC in Madrid, the goal of the GMI-AIMS-4 workshop was to:

• Discuss the state of the GMI project and the end of the design phase, proposing the Implementation phase, institutional evolution, and to discuss the following four themes:

  • Active Measurement
  • BGP
  • DNS
  • Traffic/Telescope

• Discuss the focus of the subsequent implementation phase: active measurement infrastructure, supporting data sets.