Semi-Trusted Mixer Based Privacy Preserving Distributed Data Mining for Resource Constrained Devices
Md. Golam Kaosar
School of Engineering and ScienceVictoria UniversityMelbourne, Australiamd.kaosar@live.vu.edu.au
Xun Yi, Associate Preofessor
School of Engineering and ScienceVictoria UniversityMelbourne, Australiaxun.yi@vu.edu.au
Abstract
— In this paper a homomorphic privacy preservingassociation rule mining algorithm is proposed which can bedeployed in resource constrained devices (RCD). Privacypreserved exchange of counts of itemsets among distributedmining sites is a vital part in association rule mining process.Existing cryptography based privacy preserving solutionsconsume lot of computation due to complex mathematicalequations involved. Therefore less computation involved privacysolutions are extremely necessary to deploy mining applicationsin RCD. In this algorithm, a semi-trusted mixer is used to unifythe counts of itemsets encrypted by all mining sites withoutrevealing individual values. The proposed algorithm is built onwith a well known communication efficient association rulemining algorithm named count distribution (CD). Security proofsalong with performance analysis and comparison show the wellacceptability and effectiveness of the proposed algorithm.Efficient and straightforward privacy model and satisfactoryperformance of the protocol promote itself among one of theinitiatives in deploying data mining application in RCD.
Keywords- Resource Constrained Devices (RCD), semi-trusted mixer, association rule mining, stream cipher, privacy, data mining.
I.
I
NTRODUCTION
Data mining sometimes known as data or knowledgediscovery is a process of analyzing data from different point of views and to deduce into useful information which can beapplied in various applications including advertisement,bioinformatics, database marketing, fraud detection, e-commerce, health care, security, sports, telecommunication,web, weather forecasting, financial forecasting, etc.Association rule mining is one of the data mining techniqueswhich helps discovering underlying correlation amongdifferent data items in a certain database. It can deduce somehidden and unpredictable knowledge which may provide highinterestingness to the database owners or miners.Rapid development of information technology, increasinguse of advanced devices and development of algorithms haveamplified the necessity of privacy preservation in all kind of transactions. It is more important in case of data mining sincesharing of information is a primary requirement for theaccomplishment of data mining process. As a matter of fact themore the privacy preservation requirement is increased, the lessthe accuracy the mining process can achieve. Therefore a trade-off between privacy and accuracy is determined for a particularapplication.In this paper we denote Resource Constrained Device(RCD) as any kind of device having limited capability of transmission, computation, storage, battery or any otherfeatures. Examples includes but not limited to mobile phones,Personal Digital Assistants (PDAs), sensor devices, smartcards, Radio Frequency Identification (RFID) devices etc. Wealso interpret lightweight algorithm as a simple algorithmwhich requires less computation, low communication overheadand less memory and can be deployed in a RCD. Integration of communication devices of various architectures lead to globalheterogeneous network which comprises of trusted, semi-trusted, untrustworthy, authorized, unauthorized, suspicious,intruders, hackers types of terminals/devices supported byfewer or no dedicated and authorized infrastructure. Sharingdata for data mining purposes among such resource constrainedad-hoc environment is a big challenge itself. Preservation of privacy intensifies the problem by another fold. Thereforeprivacy preserving data mining in RCD envisions facilitatingthe mining capability to all these tiny devices which may havea major impact in the market of near future.Data mining capability of RCD would flourish the futureera of ubiquitous computing too. Owner of the device wouldperform mining operation on the fly. Small sensor deviceswould be able to optimize or extend their operations based onthe dynamic circumstance instead of waiting for timeconsuming decision from the server. Scattered agents of a
(IJCSIS) International Journal of Computer Science and Information Security,Vol. 8, No. 1, April 201044http://sites.google.com/site/ijcsis/ISSN 1947-5500
security department can take instant decision of actions about acrime or a criminal while in duty. To comprehend the necessityof lightweight privacy preserving data mining, let us consideranother circumstance: there are many scattered sensor deviceslocated in a geographical location belonging to differentauthorities which are serving different purposes with somecommon records about the environment. Now if it is requiredto mine data among those sensor devices to accomplish acommon interest of the authorities in real time, then preservingprivacy would be the first issue that must be ensured. Anothermotivation behind developing our proposed system could behealthcare awareness. Let us assume some communitymembers or some university students want to know about theextent of attack of some infectious diseases such as swine flu,bird flu, AIDS etc. Each individual is very concerned about theprivacy since the matter is very sensitive. They are equippedwith a mobile phone or similar smart device and want to knowthe mining result on the fly. In such circumstances, adistributed lightweight privacy preserving data miningtechnique would provide a perfect solution. In addition to that;relevant people can be warned or prescribed based on allavailable health information including previously generatedknowledge about a particular infectious diseases.There is not much research work done for lightweightprivacy preserving data mining but there is plenty of researchon privacy preserving data mining. Essentially two mainapproaches are adapted for privacy preserving data miningsolutions. First one is the randomization which is basically usedfor centralized data. In this approach data is perturbed usingrandomization function and submitted for mining.Randomization function is chosen such that the aggregatedproperty of the data can be recognized in the miner side. In [1,2, 3] authors have proposed such approaches. One of the majordrawbacks of randomization approach is: if the precision of data mining result is increased, the privacy is not fullypreserved [4].Another one is the cryptographic approach in which thedata is encrypted before it is being shared. The miner cannotdecrypt individual inputs separately rather it needs to decryptunified encrypted data together. Therefore the miner cannotassociate particular information to a particular party. Anexample of such approach is Secure Multiparty Computation(SMC) proposed by Yao [5]. Another cryptography basedprivacy preservation technique is proposed by M. Kantarciogluand C. Clifton [6] which involves enormous amount of mathematical computation and communication between datasites. This is too heavy to be implemented in a RCD. Amongother privacy preserving data mining, [7] and [8] are oneswhich also involve vast mathematical complex equations to besolved. There are some research works on privacy issues forRCD separately too. Authors in [21] propose a technique tohide location information of a particular device for locationbased applications. A middleware LocServ is designed whichlies in between the location-based application and the locationtracking technology. A group signature based privacy forvehicles is proposed in [22], which addresses the issue of preserving privacy in exchanging secret information such asvehicle’s speed, location etc.Some research approaches address the issue of hidingsensitive information from data repository. In [23] and [24]authors basically propose some techniques to hide sensitiveassociation rules before the data is disclosed to public. Ahardware enhanced association rule mining technique isproposed in [25]. Data is needed to be fed into the hardwarebefore the hash based association rule mining process starts.This approach may not be well realistic for RCD because itrequires special purpose hardware as well as it does nothandle privacy issue. A homomorphic encryption technique;Paillier encryption is used by X. Yi and Y. Zhang [9] topreserve privacy where authors propose a privacy preservingdistributed association rule mining using a semi-trusted mixer.This algorithm involves lot of computation due to the use of complex mathematical equations and big prime numbers askeys in the Paillier encryption.A heterogeneous mobile device based data collectionarchitecture is proposed by P.P. Jayaraman [10]. Sensordevices are scattered in the environment to collect various datawhereas regular mobile phones can work as bearers of the data.Detail architecture of the model is available in [10]. Authorsdid not consider the privacy issue during the transmission of data. If the mobile devices in the environment are intended tobe utilized to work as a data bearer then privacy should be oneof the major concerns. Therefore it would be difficult to beimplementable in real life unless privacy is preserved. Alightweight privacy preserving algorithm similar like in thispaper could provide privacy preservation as well as datamining solution for these kinds of models.Main focus of CD [18] algorithm is to reducecommunication overhead with the cost of redundant parallelcomputation in each data site. In addition to that this algorithmdoes not transmit the large itemset in the association rulemining process. Rather it communicates the counts of theitemsets only, which let it reduce communication overheaddramatically. These features make it feasible to be deployed inRCD. On the other hand semi-trusted mixer based privacysolution provided by Yi and Zhang in [9] requires lot of computation with managing big encryption key size. In thispaper a more efficient semi-trusted mixer and homomorphicencryption based privacy algorithm is proposed which adoptsthe rule mining technique of CD to make the solutiondeployable in RCD.The remainder of the paper is oriented as follows: Section 2describes some necessary background information. Section 3describes proposed solution which consists of privacypreserving algorithm and association rule mining algorithm forRCD. Section 4 contains security analysis and section 5discusses the proofs and performance comparison. Finally theconclusion is presented in section 6.II.
BACKGROUND
Privacy
: According to The American Heritage Dictionaryprivacy means “The quality or condition of being secludedfrom the presence or view of others”. In data mining if the
(IJCSIS) International Journal of Computer Science and Information Security,Vol. 8, No. 1, April 201045http://sites.google.com/site/ijcsis/ISSN 1947-5500
owner of the data requires the miner to preserve privacy, thenthe miner gets no authority to use the data unless an acceptableand trustworthy privacy preservation technique is ensured.Different points of views define privacy in different ways. Forsimplicity we consider a definition which is most relevant tothis work. According to J.Vaidya [1] privacy preserving datamining technique must ensure two conditions: ‘anyinformation disclosed cannot be traced back to an individual’and ‘any information disclosed does not constitute anintrusion’. More technical definition of privacy can be foundin [11]. This paper also provides technical definition insecurity analysis in section 4.
Association Rule Mining
: Let us consider; in a distributeddata mining environment collective database DB is subdividedinto DB
1
, DB
2
, … , DB
N
in wireless data sites S
1
, S
2
, … ,S
N
respectively. I= {i
1
, i
2
, … , i
m
} is the set of items where eachtransaction T
⊆
I. Typical form of an association rule is X
⇒
Y,where X
⊆
I, Y
⊆
I and X
∩
Y=
φ
. The support
s
of X
⇒
Y is theprobability of a transaction in DB contains both X and Y. Onthe other hand confidence
c
of X
⇒
Y is the probability of atransaction containing X will contain Y too. Usually it is theinterest of the data vendor to find all association rules havingsupport and confidence greater than or equal to minimumthreshold value. For another instance of an association ruleAB
⇒
C,
⇒
C
⇒
C
⇒
C
More detail on association rule mining process isavailable in [12, 20].Association rule mining process consists of two majorparts. First one is to find frequent large itemsets which havesupport and confidence values more than a threshold numberof times. Second part is to construct association rules fromthose large itemsets. Due to the simplicity and straightforwardnature of the second part, most of the association rule miningpapers do not address this. Apriori algorithm is one of theleading algorithms, which determines all frequent largeitemsets along with their support counts from a databaseefficiently. This algorithm was proposed by Agrawal in [14]which is discussed here in brief:Let us say L
i
be the frequent i-itemsets. Apriori algorithmfinds L
k
from L
k-1
in two stages: joining and pruning:
Joining
: Generates a set of k-itemsets C
k
, known ascandidate itemsets by joining L
k-1
and other possible items inthe database.
Pruning
: Any (k−1)-itemsets cannot be a subset of afrequent k –itemset which is not frequent. Therefore it shouldbe removed.
Stream Cipher
: It is a symmetric key cipher whereplaintext bits are combined with a pseudorandom cipher bitstream typically by an XOR operation. In stream cipher a seedis used as a key to generate continuous stream of bits. Thisidea can be used in generating random keys by encrypting aconstant with the secret key/seed. Therefore multiplerandomly generated keys can be shared among multipleentities simply by sharing a seed. In our proposed algorithmwe need some randomly generated keys which can begenerated by Output Feedback Mode (OFB) of DataEncryption Standard (DES) detail of which is available in[13].
Homomorphic Encryption
: Homomorphic encryptionis a special form of encryption using which one can perform aspecific algebraic operation on the plaintext by performing thesame or different operation on the ciphertext. Detail definitioncould be found in [13]. If x1 and x2 are two plaintext and Eand D denotes encryption and decryption functionrespectively. Let us consider y1 and y2 are two ciphertextssuch that: y1=E
k
(x1) and y2=E
k
(x2) where, k is the encryptionkey. This encryption will be considered homomorphic if thefollowing condition is held: y1+y2=E
k
(x1+x2).III.
P
ROPOSED
S
OLUTIO
NIn this paper we propose a privacy preserving secretcomputation protocol which is based on a homomorphicencryption technique for distributed data sites. In this sectionfirst the privacy preserving frequency mining algorithm isdiscussed and then the modified CD algorithm is discussedwhich ensures privacy in the association rule mining process.
A. Privacy Preserving Frequency Mining
In our proposed approach, there would be a number of participating semi honest devices or data sites (>2) which areconnected to each other using heterogeneous media. Therewould be a semi-trusted mixer which would receive encryptedcount values from sites through its private channel. It isassumed that the semi-trusted mixer would never collude withany of the data site. In practice it could be assumed that it isauthorized by the government or semi-government agent. Datasites communicate to the mixer through the private channeland the mixer communicates to all sites through publicchannel. Necessary keys would be distributed to the sites bycorresponding authorities or owner of the sites. It is alsoassumed that the private channel is protected by a standardsecret key cryptosystem, such as DES [15] or AES [16]. Fig.1describes the proposed model in brief.
(IJCSIS) International Journal of Computer Science and Information Security,Vol. 8, No. 1, April 201046http://sites.google.com/site/ijcsis/ISSN 1947-5500
Search History:
Result 00 of 00
00 results for result for
p.
Semi-Trusted Mixer Based Privacy Preserving Distributed Data Mining for Resource Constrained Devices
In this paper a homomorphic privacy preserving association rule mining algorithm is proposed which can be deployed in resource constrained devices (RCD). Privacy preserved exchange of counts of itemsets among distributed mining sites is a vital…
(More)
265
Reads
1
Readcasts
0
Embed Views
Get Scribd Mobile
To get Scribd mobile enter your number and we'll send you a link to the Scribd app for iPhone & Android.We've sent a link to the Scribd app. If you didn't receive it, try again.
We'll never share your phone number.
More From This User
Notes
Load more
