sql-guessing-advantage-analyser

SQL guessing advantage analyser has a a user-facing frontend application that allows to extend models by attaching SQL scripts to its elements. SQL queries are added to tasks and SQL database information added to data objects. SQL information is attached by adding specific labels into the XML code of the model. The editor uses SQL guessing advantage analysis tool to perform an analyze on the extended model to combine and present the results. Editor and analysis tool have separate codebases, but they are both required to use the full functionality of the analyser. Communication between the two components is arranged by backend REST service.

We interpret differential privacy in terms of a more standard security measure – the attacker's guessing advantage. It is defined as the difference between the posterior (after observing the output) and prior (before observing the output) probabilities of attacker guessing the input. The analyser reports the amount of noise that need to be added to achieve a desired upper bound on advantage.

Compared to combined sensitivity analyser, the data objects of a model also have schemas and data tables, but now there are no explicit table norms. The distance measure for differential privacy will be determined in a different way.

Clicking on *Analyze* button opens a menu entitled *Analysis settings* on the right side of the page (in sidebar). In addition to the error level confidence slider that we have in combined sensitivity analyser, there is another slider allows to set desired upper bound on attacker’s advantage, which ranges between 0% and 100%.

The user has to specify the attacker's goal. Similarly to combined sensitivity analyser, user can define constraints on table attributes that are known in advance. There are two buttons for this.

The syntax for table constraints is similar to combined sensitivity analyser, with some extensions. The keyword `exact`

states that the attacker already knows some attribute precisely, and `total`

says how many elements there can be, without specifying their values. More options can be found in analyser advanced settings.

table_1.attr_1 exact; --attacker knows the exact value table_2.attr_2 total int; --there are n possible values table_3.attr_3 set v1 ... vn; --there are values {v1 ... vn} table_4.attr_4 range lb ub; --the values come from range [lb,ub)

Attacker goal is given in form of an SQL guery. It defines a set of sensitive components, which the attacker is trying to guess. Even if the attacker cannot guess the location precisely, it can still be bad even if he guesses the location precisely enough, so we need to introduce approximation. For each sensitive attribute, the guess can either be `exact`

(discrete attributes), or `approx r`

(approximated by r > 0 units). The delimiter `;`

finishes the description of the attacker goal.

SELECT t.x approx 5 AND t.y approx 5 FROM t;

In this example, the attacker wins iff he guesses both `t.x`

and `t.y`

within 5-unit precision. The definition of “unit” depends on the data table, e.g. if the location was defined in miles, then a unit is also a mile.

Additional syntax for specifying attacker goal can be found in analyser advanced settings.

Select the tasks that should be considered for the analysis (E.g. all the data processing tasks up to the computations of the value that the adversary uses for the guess). You should run the propagation if the part of the workflow that is analyzed does not start from the input objects of the process.

Click on *Run analysis* button to run analysis. The analyser internally converts these values to a suitable ε for differential privacy, and computes the noise required to achieve the bound on attacker’s advantage. The results (entitled *Analysis results*) appear in the sidebar as well. The result consists of the following components, which are the same as for combined sensitivity analyser.

**actual outputs y**are the true outputs of the query, without noise.**p%-noise magnitude a**is the additive noise magnitude, i.e. the noise stays below this quantity with probability p%.**p%-realtive error |a|/|y|**is the quotient of the additive noise and the query output. If there are several outputs, it is the quotient of corresponding vector norms.

To see more precise values of prior and posterior guessing probabilities, click *View more*. This can be useful for choosing appropriate value on the guessing advantage slider. For example, if the prior guessing probability was already 75%, then any value above 25% makes no sense since it would mean that the attacker is allowed to learn everything. Clicking *View more* also provides more information about how the noise should actually be generated, and it does it for Cauchy and Laplace noise distributions.

The source code of SQL guessing advantage editor is available at pleak-sql-guessing-advantage-editor and the source code of SQL sensitivity analysis tools at pleak-sql-analysis repositories. Installation details can be found at analyser installation guide.

sql-guessing-advantage-analyser.txt · Last modified: 2020/04/15 17:54 by pullonen