Commit 61737666 authored by Zied SELLAMI's avatar Zied SELLAMI
Browse files

Update priority-inbox result

parent 657950e9
......@@ -10,15 +10,15 @@ The tools is a rest-api that compute the category and a score from a email json
4. **TO_READ**: if the email is not **IMPORTANT** and not a **NOTIFICATION**
### First results
A small dataset of **604** emails was annotated manually (**234** important emails, **321** notification emails and **49** to_read email) was created to test this approach.
A small dataset of **706** emails was annotated manually (**310** important emails, **321** notification emails and **75** to_read email) was created to test this approach.
Remember that this AI approach are not based on Machine Learning but only on generic rules to compute a priority for an email.
**The next table resume the obtained results:**
| Email category | Precision | Recall | Fmeasure |
| -------- | -------- | -------- | -------- |
| Important | 81.90% | 73.50% | 77.47% |
| To_Read | 25.39% | 65.30% | 36.57% |
| Important | 84.50% | 77.41% | 80.80% |
| To_Read | 33.76% | 69.33% | 45.41% |
| Notification | 99.62% | 83.17% | 90.66% |
......
......@@ -7,6 +7,8 @@
<37.C8.53157.144A7E85@twitter.com> 0 N
<bsEYoj2rRReZ4oj8Dt-fXQ@ismtpd0039p1mdw1.sendgrid.net> 0 N
<Fd6AyharS5O3GduwVZ7tzw@ismtpd0019p1iad2.sendgrid.net> 0 N
<946bb9a3-45b1-c1fa-65fe-310179c32881@linagora.com> 0 I
<82a7648c-926c-84c9-5cbc-e77e6e5d90a5@linagora.com> 0 I
<30050491.20180413124138.5ad0a58271e227.82100208@mail135-3.atl141.mandrillapp.com> 0 N
<1B.7F.57134.758B0DA5@twitter.com> 0 N
<ce5efb1aa4ab5a07f9dbcda2d21f3c40@s480d.mxguarddog.com> 0 N
......@@ -28,6 +30,7 @@
<dvr9FYWoRTKTgvpJ2thqbw@ismtpd0006p1iad1.sendgrid.net> 0 N
<ZZwI84qqTW-NfKdIYKFZfQ@ismtpd0001p1iad1.sendgrid.net> 0 N
<9d0ed80f9e38222618c97793080275f7@linagora.com> 0 I
<CAL59r1xnjMVJaSPCeExELxFefrixKd2SebAs1X22rUK9u0iDCQ@mail.gmail.com> 0 I
<7067dcefb40e4b71badda284e7293e99@linagora.com> 0 T
<9e6c7c7542c2c0b1940d0c20481b8aea@linagora.com> 0 T
<6A.BE.57134.502F9DA5@twitter.com> 0 N
......@@ -47,6 +50,7 @@
<5N1Uso_cQqGlAwwV6GNSUg@ismtpd0050p1mdw1.sendgrid.net> 0 N
<6-Z2h6FvTGaANyMIgrVRLQ@ismtpd0040p1mdw1.sendgrid.net> 0 N
<e60c67b7ad98ea16cf03238021e21cff@async> 0 N
<1967800d-8329-3135-f9b6-b362289d59cd@linagora.com> 0 I
<89376341f8ab4e8717f49f0bb8c0ba6c@s480f.ik2.com> 0 N
<C5.65.48133.76C33EA5@twitter.com> 0 N
<30050491.20180427150634.5ae33c7ad28143.05226251@mail134-8.atl141.mandrillapp.com> 0 N
......@@ -55,6 +59,7 @@
<26.94.60284.15E73EA5@twitter.com> 0 N
<1493368264746.2049a2b1-8671-4d46-963d-986bae6fd602@sp01.hubspotemail.net> 0 N
<b2691baf00ce3d9f3ebd5676222362fc@async.facebook.com> 0 N
<1171598362948764-891892624252674@groups.facebook.com> 0 T
<8474ec5c3b2b97d3af9cc71da7af6531@linagora.com> 0 N
1493382215746 0 N
1493382816319 0 N
......@@ -602,3 +607,100 @@
<41ac16be-94d0-ea13-8b5a-187384001593@linagora.com> 0 T
<7eb5c0adc6cde81b5ca45a0a804f850f@linagora.com> 0 I
<5d4c22df-1673-513e-62ad-8f89928a55c1@linagora.com> 0 I
<9184339c-fb14-20dc-358c-fe3bf9c1939d@linagora.com> 0 T
<14735921-a863-cb37-d1e4-7b066b666346@linagora.com> 0 I
<CA+oNZPstgOR=AgyMgVM8vT-Up0fdP=ShjWd5ZRnYhhzmT7Gpqg@mail.gmail.com> 0 T
<edke1glmluk9j75twu2wiv10.1498405881690@email.android.com> 0 I
<CAGfz8+k4cNE-d3oHN26Pkc8DcD5QjYV+WSYWNedQ4vErd6v0aA@mail.gmail.com> 0 I
<0de443c9634ddf182b89dd4b86bf3f18@linagora.com> 0 I
<94920491.14800217.1506839417320.JavaMail.zimbra@dauphine.fr> 0 I
<DB6PR0802MB24402F3D53463C7F25B830AE8BBB0@DB6PR0802MB2440.eurprd08.prod.outlook.com> 0 I
<719585b800b042e526ffc7640e541dbd@linagora.com> 0 I
<d97b3fd4-2749-a128-6a2a-5b8f4017aa94@linagora.com> 0 I
<9d6cb1f8-bc05-14f6-6dab-3e5188ac91f9@linagora.com> 0 T
<7972beb85214351abb2f7972b8f8d936@linagora.com> 0 I
<69c7f1c6-de93-2cdb-01d5-8a6c0b64530f@linagora.com> 0 I
<c820b9da40eb7473d68afc7dc0147e59@linagora.com> 0 I
<7ddad1cd4217464f52a8d310dda66827@linagora.com> 0 T
<Mime4j.8.34780984774b6785.1658a361f4c@linagora.com> 0 I
<20180830120321.E448F1D861@obm3-ui.linagora.dc1> 0 T
1504165392922 0 T
<cmu-lmtpd-17969-1480592839-4@imap> 0 I
<58401145.2020009@linagora.com> 0 I
<b4620d79c87e5b6d5a9082028587cc23@linagora.com> 0 T
<25315bd3834337e6d4561d849cf06a1f@linagora.com> 0 I
<9ce899416838fc8009e90c7da7db80e6@linagora.com> 0 T
<77f6b5df2ab8eebe542510c67c2d960e@linagora.com> 0 I
<08d1ec3be7bf3fddd85c59227adb8da2@linagora.com> 0 I
<f1712b7832661fe12f965c2f208101be@linagora.com> 0 I
<916e6e7cccd39df6cb5afd2023a6e485@linagora.com> 0 I
<1763457289.4736074.1544089983562@mail.yahoo.com> 0 I
<4970a95d-ed5f-a355-a1a3-6c8f2f0a2cfb@linagora.com> 0 I
<5pvetg4odi9sg9mwu5jjbuqo.1544096297469@email.android.com> 0 I
<etPan.5a28eca3.643c9869.1873@linagora.com> 0 I
<etPan.5a28f46b.19495cff.1873@linagora.com> 0 I
<51bf1bde-3873-84d0-b4ef-8efaec78a21d@linagora.com> 0 I
<1488ff97-6a4f-70f0-8f42-75e74825c0cb@linagora.com> 0 I
<CA+OoMgwq4rNC0bFi1u3fDfhAtW0NUH+E_=pyjSONJ1FAmW2Fdg@mail.gmail.com> 0 T
<2aef5960b01506c9754c82126fbbe88d@linagora.com> 0 I
<CAPsZ-WZMMfWP=80hkmoMsegXtHje8PH-mvByHhcPVjj2gjVc9A@mail.gmail.com> 0 T
<CA+oNZPu9wvXL_-kL-nTuwJoWHAOMFOJxc-VLo5DDo9zpHG5x7w@mail.gmail.com> 0 T
<eca4fa61df863dda75daf06dab91df16@linagora.com> 0 I
<CANt9njqN3waQ6Hi=4Jmm0F-SSN__9NVyKhHX6OWFTUxYmT+FmA@mail.gmail.com> 0 T
<oet9frqphegu509yim4w7jyh.1481221573848@email.android.com> 0 I
<DB6PR1001MB0968CE42B2D1F3415BEF70E7A50A0@DB6PR1001MB0968.EURPRD10.PROD.OUTLOOK.COM> 0 I
<DB6PR1001MB0968A34B7D4B2272A9F1206FA50A0@DB6PR1001MB0968.EURPRD10.PROD.OUTLOOK.COM> 0 I
<45106248-892b-bea1-79d4-7ba615a12eeb@linagora.com> 0 I
<CALYj=qDmmGh=BVfMOgbCdUE59mFdgKh84mpfXp6i10S5ZRAJ9Q@mail.gmail.com> 0 T
<585c47bd.2350c20a.e5711.4147@mx.google.com> 0 T
<facebook/duckling/pull/153/c362173276@github.com> 0 I
<20180201125111.AF79E1D860@obm3-ui.linagora.dc1> 0 T
<facebook/duckling/pull/153/c362355470@github.com> 0 I
<facebook/duckling/pull/153/issue_event/1453578367@github.com> 0 I
<42f07ebd-e293-b62c-09e4-4ca9058c0a16@linagora.com> 0 I
<CAGKx02uPeqFjs-zE7i_c9t4hFMLzXKd4ZjWBetoPjOtkjVx+Bw@mail.gmail.com> 0 I
<21297_1518094509_5A7C48AD_21297_157_9_24711ec3-a231-7eaf-a27d-0ac096f98848@dgfip.finances.gouv.fr> 0 I
<f5c746fb-9e23-8966-1b99-c5ec6f517b2b@linagora.com> 0 I
<58fa7a9d-42e3-ca14-2563-f3191cf2ecb4@linagora.com> 0 I
<9ccdf485-cd0a-0d6c-10d2-4426b2cf4c7c@linagora.com> 0 I
<8132df54-99df-0e65-1ea1-f9576bea5ad8@linagora.com> 0 T
<CAOBK-d=YSBt7_JPe4pvY6hDVZjv8h03QbW9ctinDpx+4L5TCag@mail.gmail.com> 0 T
<9dd496a6-a436-4f40-93b0-cbee6aaaee46@email.android.com> 0 I
<1d6e6185-2d0a-ee2f-4809-44b3859147e8@linagora.com> 0 I
<CAJLRrFw33+zfJEg3dKr6V4CSNTPdDXBtaco7ouVokkq906uuhw@mail.gmail.com> 0 T
<CAJLRrFyQ8a7bFKzZ+5Hq0Br1woFVJ8aEq46Qk=P0f30wvDG==Q@mail.gmail.com> 0 T
<37602914-c86b-7ea2-ba0b-9f82bcb06e7e@linagora.com> 0 I
<fd351458-7263-8a5b-207c-a1245e5aa68c@linagora.com> 0 I
<6f82b80bffa07382971cb9db4d12a549@linagora.com> 0 I
<50177fb1b6c72084273d9807205735c7@linagora.com> 0 I
<f97a326c-36ee-946c-c6e9-2de75ba012b1@linagora.com> 0 I
<CAMKFHG9ns78uwpRS_m__4eNiuyM_9VirkdmXAh=O9hrqNaEU3Q@mail.gmail.com> 0 T
<411816c2-707d-b6a2-8135-afdbc81f34a2@linagora.com> 0 I
<2d124e8e-070a-13b0-2933-b2d892bcbb34@linagora.com> 0 I
<cf14e52c-524b-a337-5115-def3048f9ce3@linagora.com> 0 I
<52463251-2d00-a1b8-dc8e-5ed18a5886b9@linagora.com> 0 I
<CAEDqhtHNOgNFfq1UFBH7a5n61EORzQuK7NeCpuuKBSpgsEt1fw@mail.gmail.com> 0 I
<4a8b7658-84a6-23ba-22f8-564586c3ce8e@linagora.com> 0 I
<f9750381-4b91-0428-5e70-0876d47c0abb@linagora.com> 0 I
<b6191a60-c1a9-7ba9-811d-8e6448b9711c@linagora.com> 0 I
<684473529.351.1516263838575.JavaMail.tomcat6@easp-tisseo> 0 T
<c0e37b477b172dba4f9c27b522ea22c8@linagora.com> 0 I
<CA+Zx+aT7uACHv1ZksPndFeELgc5FQWoe6CA2NEmkYxqEenqefw@mail.gmail.com> 0 T
<125965845.182096.1548350610471@scout-f4.univ-toulouse.fr> 0 I
<26dadf17-87f6-56bc-468a-4856a80fecf2@linagora.com> 0 I
<2f8681fa-6b7c-b5f8-d0ae-509a5386e37f@linagora.com> 0 I
<CAOBK-dkMxnusvGNGF4YJPqvstMAR8qbyZt1sVtSj9yEAFQBnnQ@mail.gmail.com> 0 T
<ae0bd31c-1c85-e49c-8733-16f29e656433@linagora.com> 0 I
<3c1511db-9aac-acb7-0a29-6b554d7f2686@linagora.com> 0 I
<76e95d8069ee226dca21c0386b957780@linagora.com> 0 T
<q3t3kovtdcpcc8b29a1qvckp.1499928112163@email.android.com> 0 I
<26aaa727b66a65d4a895b14064cdc2da@linagora.com> 0 I
<Mime4j.7.1bac06c023e71ee4.164b18b2157@linagora.com> 0 I
<Mime4j.22.f1b40ca8e72cd21e.164b2e62fb9@linagora.com> 0 I
<Mime4j.28.1dbdbc4c03ec487f.164b3bb7860@linagora.com> 0 I
<Mime4j.29.4c5601bdeed39ccd.164b3bec77d@linagora.com> 0 I
<6177233721fdde44c2705fb41025ec0a@linagora.com> 0 I
<5D465239-ADFF-4966-B57A-01A9E33C87CD@linagora.com> 0 T
<d8ac15d345a8ceca7c35e6295624403e@linagora.com> 0 I
<Mime4j.1.d55481feb523afb6.163fd51dd56@linagora.com> 0 I
<9cc16c0b-37da-fdc6-7fe7-dc2c30743384@linagora.com> 0 I
\ No newline at end of file
Président de la République, President, Présidence de la république
Premier Ministre, Prime Minister
Ministre, Minister
PDG, Président Directeur Général, President
PDG, Président Directeur Général, President, Chairman
Chef de Cabinet, Directeur de Cabinet, Chief of Staff
Vice-Président, Vice Président, Vice President
Sénateur, Senator
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment