Human Generated Data

Title

Untitled (carnival king and queen with court)

Date

1948

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18354

Human Generated Data

Title

Untitled (carnival king and queen with court)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Clothing 100
Apparel 100
Person 99.6
Human 99.6
Person 99.5
Person 99.3
Person 98.6
Robe 98.5
Fashion 98.5
Person 98.3
Gown 98.1
Person 97.7
Female 97
Wedding 96.8
Person 96.6
Bride 96.4
Wedding Gown 96.4
Coat 94.8
Suit 94.8
Overcoat 94.8
Person 93.8
Person 92.4
Person 92.3
Person 91.7
Dress 91.1
Person 89.6
Woman 88.6
Evening Dress 81.8
Person 78.7
Bridegroom 76.7
Helmet 71.9
Flower 67.4
Plant 67.4
Blossom 67.4
Crowd 66
Tuxedo 65.4
People 62.8
Shoe 61.7
Footwear 61.7
Photography 59.6
Photo 59.6
Flower Arrangement 57.7
Long Sleeve 55.6
Sleeve 55.6

Imagga
created on 2022-03-04

businessman 47.6
business 41.9
male 38.3
people 36.8
man 36.3
office 33
men 32.6
meeting 31.1
team 30.4
corporate 28.3
group 28.2
person 28.2
businesswoman 27.3
adult 27.1
professional 25.6
businesspeople 25.6
teamwork 25
worker 24.7
job 23.9
happy 23.8
executive 23.4
suit 20.9
work 19.6
success 17.7
colleagues 17.5
successful 17.4
career 17
employee 16.9
smiling 16.6
manager 15.8
women 15.8
desk 15.1
working 15
standing 14.8
coworkers 14.7
conference 14.7
discussion 14.6
confident 14.5
boss 14.3
communication 14.3
clothing 14.1
indoors 14
associates 13.8
laptop 13.7
businessmen 13.6
staff 13.5
together 13.1
building 13.1
company 13
table 13
cooperation 12.6
hands 12.2
portrait 11.6
room 11.6
handsome 11.6
mid adult 11.6
baron 11.4
hall 11.4
waiter 11.3
modern 11.2
happiness 11
lifestyle 10.8
smile 10.7
30s 10.6
diversity 10.6
partnership 10.6
talking 10.4
couple 10.4
looking 10.4
entrepreneur 10.1
attractive 9.8
cheerful 9.7
40s 9.7
new 9.7
computer 9.6
ethnic 9.5
spectator 9.3
indoor 9.1
uniform 9
discussing 8.8
diverse 8.8
workers 8.7
partner 8.7
corporation 8.7
four 8.6
formal 8.6
casual 8.5
finance 8.4
teacher 8.4
black 8.4
horizontal 8.4
student 8.3
20s 8.2
handshake 7.8
well dressed 7.8
middle aged 7.8
sitting 7.7
tie 7.6
dining-room attendant 7.5
presentation 7.4
inside 7.4
occupation 7.3
medical 7.1

Google
created on 2022-03-04

Microsoft
created on 2022-03-04

person 98.9
clothing 97.5
text 89.9
woman 83
concert 81.1
man 79.4
standing 76.6
musical instrument 74.6
dress 60.7
people 56.9
group 56.7
black and white 56.1

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Male, 96%
Calm 99.5%
Surprised 0.3%
Happy 0%
Disgusted 0%
Sad 0%
Angry 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 27-37
Gender Male, 100%
Surprised 72.1%
Calm 19.6%
Sad 2.2%
Fear 2.1%
Happy 1.8%
Angry 1.1%
Disgusted 0.6%
Confused 0.5%

AWS Rekognition

Age 30-40
Gender Male, 99.7%
Calm 99.2%
Happy 0.3%
Confused 0.1%
Surprised 0.1%
Sad 0.1%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 33-41
Gender Female, 54.8%
Surprised 28.3%
Calm 23.3%
Happy 17.7%
Disgusted 14.6%
Sad 7.4%
Angry 4.3%
Confused 2.2%
Fear 2.2%

AWS Rekognition

Age 29-39
Gender Male, 77.1%
Calm 89.4%
Happy 8.6%
Surprised 0.7%
Sad 0.5%
Confused 0.3%
Disgusted 0.3%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.7%
Calm 99%
Sad 0.4%
Surprised 0.2%
Happy 0.2%
Fear 0.1%
Confused 0.1%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 93%
Happy 3.8%
Surprised 1.1%
Fear 0.6%
Confused 0.5%
Sad 0.4%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 27-37
Gender Male, 99.8%
Calm 84.8%
Confused 4.4%
Surprised 3.1%
Sad 2.8%
Disgusted 1.7%
Angry 1.7%
Happy 0.9%
Fear 0.5%

AWS Rekognition

Age 47-53
Gender Male, 99.6%
Calm 96.6%
Sad 1.6%
Surprised 1.1%
Angry 0.2%
Confused 0.2%
Disgusted 0.2%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 70%
Calm 54.8%
Surprised 26.2%
Fear 12%
Angry 2.4%
Disgusted 1.5%
Happy 1.2%
Sad 1.1%
Confused 0.8%

AWS Rekognition

Age 30-40
Gender Male, 93.6%
Calm 99.7%
Sad 0.1%
Surprised 0.1%
Disgusted 0%
Happy 0%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 53.1%
Fear 32.2%
Sad 27%
Happy 24.8%
Calm 7.8%
Surprised 3%
Confused 1.9%
Angry 1.8%
Disgusted 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Helmet 71.9%
Shoe 61.7%

Captions

Microsoft

a group of people standing in front of a crowd 93.5%
a group of people standing in front of a crowd posing for the camera 91.5%
a group of people standing in front of a crowd of people 91.4%

Text analysis

Amazon

CARNIVAL
a
CARNIVAL QUEEN
QUEEN

Google

QUEENM
AL
AL QUEENM