Technical Reports
- Report Date Covered Start
2020-09-01
- Report Date Covered End
2021-09-18
- Report Submission Date
2022-04-13
- Project Implementation Countries
New Zealand
- Project Leaders
- Richard Nelson
- Team Members
- Shane Alcock [email protected]
- Partner Organizations
- Total Budget Approved
USD 30000
Open Lawful Intercept for Asia Pacific
University of Waikato
This project is to improve network operations in Asia Pacific in the area of Lawful Intercept. OpenLI is the only open source software capable of meeting the ETSI standards for lawful interception. OpenLI has achieved broad acceptance among network operators in New Zealand but is not well known in other countries. It has benefits beyond low cost in that OpenLI is easy to deploy and maintain and is capable of high performance (i.e. multiple Gbps of concurrent interception). We intend to work with APNIC to reach out to operators in other Asia Pacific jurisdictions to understand their requirements for lawful intercept. We will then provide development, training and other improvements as required to meet those requirements. Once the development is complete, we will develop an engagement process to collaborate with network operators to deploy OpenLI and demonstrate that it is capable of meeting their lawful intercept requirements. The long term aim is to move OpenLI to a sustainable model where the software is reliable and well maintained and continuously developed to meet new network and law enforcement requirements.
Background and Justification:[Back to table of contents]
What is Lawful Interception? Many network operators have a regulatory requirement to incorporate Lawful Interception (LI) capabilities into their networks, so that Law Enforcement Agencies (LEAs) can commission authorized electronic surveillance of specific network users. Operators that fail to comply with LI requirements can find themselves subject to prosecution, and the penalties are designed to strongly encourage compliance (for instance, in New Zealand non-compliance may result in a fine of up to $500,000 NZD plus a further $50,000 NZD per day for continued non-compliance). What constitutes an acceptable intercept can vary across jurisdictions; some agencies will still accept pcap files of the target’s traffic that are delivered after an event, but it is now increasingly common for agencies to mandate intercepts in a format that can better withstand scrutiny in court. There are two sets of standards that have been defined for this purpose: CALEA (which is used in North America) and ETSI (which is used in Europe and the Asia Pacific). Both standards are much more onerous for the operator than simply delivering pcap captures. The intercepted traffic must be delivered to the LEAs in realtime without any loss, over an encrypted channel. The intercept must be accompanied by a stream of ‘Intercept Related Information’ (IRI), which contains metadata about the communication session itself. Individual IP sessions or VOIP calls for a target must have their own unique identifier, and each intercepted packet must be tagged with a sequence number to allow LEAs to detect missing or reordered segments. There are distinct ETSI standard encapsulations for intercepted packets that are defined for different communication methods, for example IP, VOIP, mobile data, and email. The Problem Existing vendor solutions that implement the ETSI standards can cost upwards of $50,000 USD plus ongoing licensing costs. This price may be affordable for the larger operators in wealthy economies but smaller operators or operators based in developing countries will find the cost of the vendor solutions to be prohibitive. Another issue is that the vendor solutions are closed source and cannot be easily audited to ensure that there are no backdoors that would allow unauthorized entities to perform surveillance on the network. Accusations of covert backdoors in LI-capable commercial vendor equipment often attract mainstream media attention , so this is a genuine concern for both operators and LEAs. The problems that we have described affect companies that provide Internet services to paying customers, rather than directly affecting individuals of any particular gender. An operator that is forced to license a vendor solution for LI may need to increase the prices that they charge for their services to recoup the cost but this increase would most likely be applied to all customers, regardless of their gender. We feel, therefore, that the underlying problem that we are trying to address (unaffordable lawful interception solutions for small or disadvantaged network operators) is relatively gender-neutral. Our Solution The OpenLI project aims to provide smaller and less wealthy Internet Service Providers (ISPs) with a viable open source alternative that they can use to meet their lawful intercept regulatory requirements. OpenLI began as a collaboration between the WAND network research group at the University of Waikato and members of the New Zealand Network Operators Group, whereby the WAND group would apply its expertise in network packet capture to develop software that would allow the operators to comply with the ETSI LI standards and the operators would contribute money into a funding pool to cover the development costs (such as the salary of the researchers working on the software). To date, we have received funding contributions from 10 New Zealand ISPs, 1 ISP from Brazil and the New Zealand Internet Exchange. We also applied for and received a Community grant from InternetNZ to assist with ongoing development of the OpenLI system. Combined, this funding has covered the costs incurred over two years of development thus far. In 2019, the OpenLI project was a finalist in the New Zealand Hi-Tech Awards in the "Best Hi-Tech Solution for the Public Good" category. Public releases of the OpenLI software have been available for 18 months and there have been multiple successful deployments of the OpenLI system by New Zealand operators which have been confirmed as suitably compliant by the NZ Police. The software itself remains free and open source, and can also therefore be independently verified as free of any covert or government-mandated backdoors. An ongoing challenge now for the OpenLI project is to ensure that the project is sustainable: the project must continue to cover the costs associated with maintaining and supporting the software so that it can remain available for any operators that may need it.Project Implementation:[Back to table of contents]
The project has three planned phases. Phase 1 is Information Gathering and Building Relationships. We have created a reference list of countries in the Asia Pacific region with as much as we can discover about the requirements for lawful intercept and the legal environment. This was challenging because the information tends to be communicated directly from LEA to operator, instead of made publicly available. We had to read and interpret legislation in some cases. We have given a range of talks and NOG events and have started receiving and actively responding to international enquiries. See more under project communications. Due to CoVID-19 travel restrictions this has been in the form of video talks which has allowed attendance at a wide range of NOG events but limited the chances of meeting people in person. We are working on developing a tutorial series to teach network operators about lawful interception, packet capture and the use of OpenLI. This is planned to be released as pre-recorded videos (with accompanying Docker images for hands-on exercises), but we also aim to run live interactive versions much like the APNIC / NSRC workshops (possibly with some assistance from those organizations). Phase 2 is Implementation There have been seven OpenLI releases since start of September 2020 Key features added:- Significant performance improvements, particularly through caching encoded packets.
- Support for HI1 operations messages (required by many LEAs and requested by NZ operators).
- Security enhancements, such as authentication for the REST API and running packaged binaries as a non-root user.
- Allow use of RabbitMQ to buffer encoded records onto disk when collectors cannot reach mediators.
- Allow packaged installs to co-exist alongside system loggers other than rsyslog.
- BER encoding was added experimentally but removed based on operational feedback.
- Many other bug fixes and performance improvements, mostly resulting from user reports.
Project Evaluation:[Back to table of contents]
At the moment we believe we have achieved most of our objectives. It is however difficult with an open source project to definitively know how many users we do have and particularly how many people are using it in production rather than just looking out of interest. Both the number of package downloads and the variety of downloaders appear to be steadily increasing over time. We have presented talks at five different events. Our talks have aimed to educate about LI concepts as well as promote OpenLI. However the number of enquiries we receive, although small, appears to be increasing. We have received more international enquiries since the start of this project than we did in the previous two years of OpenLI development. This can only be because of the outreach activities undertaken as part of the project. We have maintained a regular development and release cycle. Projects that do not appear active may struggle to gain support. NZ operators have been happy with level of maintenance and support so far, as evidenced by their willingness to sign up for ongoing support contracts.Indicators | Baseline | Project activities related to indicator | Outputs and outcomes | Status |
---|---|---|---|---|
How do you measure project progress, linked to the your objectives and the information reported on the Implementation and Dissemination sections of this report. | Refers to the initial situation when the projects haven’t started yet, and the results and effects are not visible over the beneficiary population. | Refer to how the project has been advancing in achieving the indicator at the moment the report is presented. Please include dates. | We understand change is part of implementing a project. It is very important to document the decision making process behind changes that affect project implementation in relation with the proposal that was originally approved. | Indicate the dates when the activity was started. Is the activity ongoing or has been completed? If it has been completed add the completion dates. |
Enquiries to the project from network operators.
|
None
|
Publicity: talks, website
|
Multiple enquiries from India, other enquiries from Australia, Pakistan, Germany, Africa, Turkey, the USA, Brazil and Mexico.
|
Ongoing |
Support contracts
|
None
|
Deployed succesfully.
|
Six NZ based contracts signed.
|
Ongoing |
New countries / Jurisdictions
|
New Zealand only
|
International talks and other publicity
|
Contract signed with India and Croatia
|
Ongoing |