Human Generated Data

Title

Piazza della Signoria, Florence, Italy
Date

1998-2000
People

Artist: Kate Freedberg, American 1958 - 2010
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Kate, Maurice R. and Melvin R. Seiden Purchase Fund for Photographs, P2001.15.1

Human Generated Data

Title

Piazza della Signoria, Florence, Italy

People

Artist: Kate Freedberg, American 1958 - 2010

Date

1998-2000

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kate, Maurice R. and Melvin R. Seiden Purchase Fund for Photographs, P2001.15.1

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Person 99.7
Human 99.7
Person 99
Person 98.8
Person 97.7
Person 97.7
Person 96.9
Person 96.4
Person 96.4
Person 96.1
Person 95.8
Person 95.4
Crowd 94.8
Person 94.5
Person 94.4
Person 91.6
Person 91.6
Person 87.6
Leisure Activities 85.6
Parade 80.1
Festival 76.9
Person 69.1
Fence 68.4
Carnival 65.7
People 65.3
Clothing 58.1
Apparel 58.1
Circus 57.5
Musician 55.9
Musical Instrument 55.9
Symbol 55.8
Person 55.5

Clarifai
created on 2023-10-30

people 98.9
street 98.4
city 95
group together 95
flag 94.4
competition 93.6
man 92.6
group 92.2
crowd 91.2
road 89
festival 89
parade 88.5
woman 87.7
football 87.5
celebration 86.2
many 85.6
vehicle 82.1
ceremony 81.3
public show 80
sports fan 79.4

Imagga
created on 2022-05-28

percussion instrument 69.6
musical instrument 56.3
drum 44.5
sport 25.4
marimba 24.3
people 22.8
man 22.1
male 21.3
steel drum 19.5
group 17.7
playing 16.4
person 16
fun 15.7
music 15.4
happy 15
friends 15
entertainment 14.7
adult 14
men 13.7
musician 13.1
party 12.9
smiling 12.3
lifestyle 12.3
color 12.2
stage 11.3
player 11
culture 10.2
teenager 10
game 9.8
night 9.8
play 9.5
club 9.4
evening 9.3
black 9
life 8.9
celebration 8.8
equipment 8.8
women 8.7
boy 8.7
table 8.6
attractive 8.4
competition 8.2
singer 8.2
performer 8.1
colorful 7.9
nightlife 7.8
casino 7.8
band 7.8
concert 7.8
musical 7.7
risk 7.6
student 7.5
human 7.5
tartan 7.4
teen 7.3
cheerful 7.3
ball 7.2
school 7.2
handsome 7.1
portrait 7.1
together 7

Google
created on 2022-05-28

Musician 87
Drum 86.7
Flag 81.7
Idiophone 81.3
Shorts 79.1
Entertainment 76
Musical instrument 75.8
Fan 75.5
Crowd 75.4
Recreation 74.6
Event 74.4
Stage equipment 74
T-shirt 71
Public event 66.4
Chair 65.8
Team 65.3
Percussion 65.2
Leisure 65.1
Suit 64.6
Motor vehicle 64.4

Microsoft
created on 2022-05-28

clothing 97.1
person 90.5
indoor 87.8
bicycle 76.4
man 75.7
sports equipment 74.1
drum 63.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Sad 99.9%
Fear 10.4%
Surprised 6.6%
Calm 5.6%
Disgusted 2.2%
Angry 1.9%
Happy 1.1%
Confused 0.8%

AWS Rekognition

Age 20-28
Gender Male, 54.8%
Calm 86.4%
Surprised 6.7%
Sad 6.1%
Fear 6%
Angry 1.7%
Happy 1.7%
Disgusted 0.7%
Confused 0.5%

AWS Rekognition

Age 27-37
Gender Female, 97%
Sad 99.9%
Calm 10.6%
Surprised 6.7%
Fear 6.3%
Happy 2.9%
Confused 2.3%
Disgusted 2.2%
Angry 1.5%

AWS Rekognition

Age 24-34
Gender Female, 85.7%
Happy 97.7%
Surprised 6.6%
Fear 5.9%
Sad 2.2%
Calm 0.7%
Confused 0.3%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 31-41
Gender Male, 56.4%
Happy 86.8%
Surprised 6.5%
Fear 6.1%
Disgusted 4.7%
Calm 4.3%
Sad 2.5%
Angry 1.3%
Confused 1%

AWS Rekognition

Age 22-30
Gender Female, 71.6%
Calm 38.8%
Fear 27%
Sad 14.5%
Angry 7.8%
Surprised 7.5%
Disgusted 6.2%
Happy 2.5%
Confused 1.6%

AWS Rekognition

Age 35-43
Gender Female, 54.1%
Disgusted 31.7%
Angry 20.8%
Fear 17.9%
Surprised 9.2%
Sad 8.4%
Calm 5.7%
Confused 5%
Happy 3.3%

AWS Rekognition

Age 22-30
Gender Female, 100%
Surprised 35%
Disgusted 27.2%
Confused 26%
Happy 11.6%
Fear 6.9%
Calm 3.8%
Angry 3.3%
Sad 2.6%

AWS Rekognition

Age 16-24
Gender Female, 92.4%
Sad 99.9%
Happy 17%
Surprised 6.6%
Fear 6%
Angry 3%
Confused 1.4%
Disgusted 0.6%
Calm 0.4%

AWS Rekognition

Age 2-8
Gender Female, 89.7%
Calm 74.2%
Sad 9%
Surprised 7%
Fear 6.7%
Confused 5.7%
Disgusted 3.7%
Angry 1.5%
Happy 0.6%

AWS Rekognition

Age 39-47
Gender Female, 100%
Sad 43.8%
Calm 37.6%
Surprised 10.7%
Fear 10.1%
Angry 8.2%
Confused 5%
Happy 4.6%
Disgusted 4.1%

AWS Rekognition

Age 21-29
Gender Female, 83.1%
Sad 99.7%
Calm 18.5%
Disgusted 7.7%
Fear 6.7%
Surprised 6.7%
Angry 1.6%
Confused 1.6%
Happy 0.5%

AWS Rekognition

Age 21-29
Gender Female, 69.6%
Sad 90.7%
Angry 13.8%
Disgusted 11.1%
Calm 9.9%
Happy 9.8%
Fear 9.3%
Surprised 7.3%
Confused 3.3%

AWS Rekognition

Age 27-37
Gender Female, 99.7%
Sad 99.9%
Fear 12.8%
Surprised 7%
Disgusted 5.3%
Happy 2.1%
Angry 1.8%
Calm 1.8%
Confused 0.7%

AWS Rekognition

Age 21-29
Gender Female, 68.6%
Calm 48.2%
Fear 27.2%
Sad 8.3%
Surprised 7.7%
Confused 5.1%
Angry 3.2%
Disgusted 2.2%
Happy 2.1%

AWS Rekognition

Age 25-35
Gender Male, 99.6%
Sad 100%
Surprised 7%
Fear 6.5%
Calm 2%
Angry 1.7%
Disgusted 1.3%
Confused 0.6%
Happy 0.5%

AWS Rekognition

Age 23-33
Gender Female, 99.9%
Happy 57.5%
Calm 29%
Surprised 8.4%
Fear 6.4%
Sad 3.4%
Angry 2.2%
Disgusted 1.8%
Confused 1.3%

AWS Rekognition

Age 16-22
Gender Female, 99.8%
Calm 62.3%
Confused 18.1%
Angry 8.9%
Surprised 7.1%
Fear 6.6%
Happy 4.4%
Sad 2.7%
Disgusted 1.1%

AWS Rekognition

Age 30-40
Gender Female, 75%
Sad 100%
Surprised 6.3%
Fear 5.9%
Disgusted 0.5%
Confused 0.2%
Calm 0.2%
Happy 0.1%
Angry 0.1%

AWS Rekognition

Age 21-29
Gender Female, 98.9%
Calm 46.9%
Sad 28.4%
Fear 12.9%
Surprised 8.8%
Angry 6.5%
Happy 4.5%
Disgusted 2.9%
Confused 1.8%

AWS Rekognition

Age 18-26
Gender Female, 100%
Happy 46%
Fear 18.3%
Sad 8.3%
Surprised 8.1%
Calm 7.2%
Disgusted 7%
Angry 6.7%
Confused 0.8%

AWS Rekognition

Age 21-29
Gender Male, 78%
Sad 78%
Calm 54%
Fear 6.9%
Surprised 6.8%
Disgusted 2.1%
Happy 2%
Confused 1.5%
Angry 1.3%

AWS Rekognition

Age 24-34
Gender Female, 76.7%
Sad 99.7%
Disgusted 30.6%
Fear 6.4%
Surprised 6.3%
Angry 0.7%
Happy 0.3%
Confused 0.3%
Calm 0.2%

AWS Rekognition

Age 22-30
Gender Female, 98.4%
Surprised 65.4%
Disgusted 25.7%
Sad 14.7%
Calm 9.7%
Fear 8.2%
Angry 2.3%
Happy 2.3%
Confused 1.4%

AWS Rekognition

Age 2-8
Gender Male, 76.7%
Surprised 43.1%
Calm 36.4%
Happy 17%
Fear 6.9%
Disgusted 5.4%
Confused 4.7%
Angry 3.8%
Sad 2.8%

AWS Rekognition

Age 18-26
Gender Male, 98.1%
Calm 97.1%
Surprised 7%
Fear 5.9%
Sad 2.2%
Confused 0.6%
Disgusted 0.2%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Disgusted 91.2%
Surprised 7.2%
Fear 6%
Angry 4.5%
Sad 2.4%
Happy 0.5%
Calm 0.5%
Confused 0.2%

AWS Rekognition

Age 16-22
Gender Male, 98.7%
Calm 83.9%
Fear 8%
Surprised 6.7%
Confused 3.5%
Sad 3.4%
Happy 1.7%
Disgusted 1%
Angry 0.6%

AWS Rekognition

Age 11-19
Gender Female, 87.9%
Angry 33.4%
Calm 33.3%
Sad 14%
Happy 8.9%
Surprised 7.5%
Fear 6.6%
Disgusted 5.4%
Confused 0.7%

AWS Rekognition

Age 26-36
Gender Female, 65.8%
Sad 76.3%
Surprised 50.7%
Fear 13.6%
Confused 7.5%
Calm 4.7%
Disgusted 3.2%
Angry 2.4%
Happy 1.7%

AWS Rekognition

Age 18-26
Gender Female, 91.7%
Fear 54.3%
Surprised 22.8%
Calm 22.7%
Happy 5.3%
Confused 4.5%
Sad 3.5%
Angry 1.6%
Disgusted 1.3%

AWS Rekognition

Age 27-37
Gender Male, 90.8%
Calm 90.2%
Surprised 6.8%
Happy 6.4%
Fear 6%
Sad 2.3%
Disgusted 1.1%
Angry 0.4%
Confused 0.2%

AWS Rekognition

Age 22-30
Gender Male, 99.7%
Angry 41%
Disgusted 19.6%
Sad 18.6%
Happy 8.2%
Fear 8.1%
Surprised 7.3%
Calm 4.4%
Confused 3.2%

AWS Rekognition

Age 7-17
Gender Male, 77.9%
Calm 97.3%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Disgusted 0.8%
Confused 0.4%
Happy 0.4%
Angry 0.3%

AWS Rekognition

Age 16-24
Gender Female, 98.9%
Fear 42%
Surprised 29.1%
Calm 23.6%
Disgusted 7.2%
Sad 3.7%
Confused 3.6%
Angry 2.5%
Happy 1.7%

AWS Rekognition

Age 23-33
Gender Male, 99.7%
Calm 70.6%
Sad 19.1%
Angry 6.9%
Fear 6.7%
Surprised 6.6%
Disgusted 1.3%
Happy 1.1%
Confused 0.8%

AWS Rekognition

Age 40-48
Gender Female, 86%
Sad 83.1%
Happy 37.9%
Fear 8.2%
Surprised 7.7%
Calm 7.6%
Disgusted 4.2%
Angry 3.2%
Confused 1.3%

AWS Rekognition

Age 35-43
Gender Male, 98.9%
Calm 46.3%
Sad 22.8%
Confused 15.3%
Disgusted 8.2%
Surprised 7.7%
Fear 6.6%
Happy 3.9%
Angry 3.7%

AWS Rekognition

Age 16-24
Gender Male, 72.9%
Calm 55%
Angry 36.5%
Surprised 6.5%
Fear 6.2%
Sad 3.9%
Disgusted 1.3%
Confused 0.9%
Happy 0.5%

AWS Rekognition

Age 25-35
Gender Female, 56.5%
Calm 57.8%
Disgusted 23.5%
Sad 12.3%
Surprised 6.4%
Fear 6%
Confused 2.8%
Happy 1.4%
Angry 0.7%

AWS Rekognition

Age 6-16
Gender Male, 99.8%
Calm 78.4%
Angry 6.8%
Surprised 6.8%
Fear 6.1%
Sad 5.7%
Disgusted 3.2%
Confused 1.9%
Happy 1.1%

AWS Rekognition

Age 18-26
Gender Female, 90.6%
Confused 37.2%
Calm 21.9%
Fear 19.6%
Surprised 8.3%
Sad 7.1%
Angry 4.4%
Disgusted 2.4%
Happy 1.5%

AWS Rekognition

Age 6-14
Gender Male, 99.7%
Fear 94.1%
Calm 8.3%
Surprised 6.7%
Sad 3.2%
Confused 2.5%
Happy 2.1%
Angry 0.5%
Disgusted 0.3%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Calm 55.2%
Sad 35.1%
Surprised 9.3%
Confused 8.7%
Fear 6.1%
Happy 4.2%
Angry 2.1%
Disgusted 1.8%

AWS Rekognition

Age 4-10
Gender Female, 55.6%
Sad 100%
Surprised 6.4%
Fear 6.1%
Disgusted 0.2%
Confused 0.2%
Angry 0.1%
Happy 0.1%
Calm 0.1%

AWS Rekognition

Age 30-40
Gender Male, 87.9%
Happy 94.7%
Surprised 6.6%
Fear 6%
Sad 2.5%
Calm 2.3%
Confused 0.5%
Disgusted 0.3%
Angry 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

events parties 70.4%
people portraits 17.8%
food drinks 8.1%
text visuals 2%

Text analysis

Amazon

!

Google

LYWINGS