Human Generated Data

Title

Untitled (group throwing rice on newlywed couple emerging from house)
Date

1949
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9273

Human Generated Data

Title

Untitled (group throwing rice on newlywed couple emerging from house)

People

Artist: Martin Schweig, American 20th century

Date

1949

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9273

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.6
Human 99.6
Person 99.3
Person 99.2
Person 99.2
Clothing 99.1
Apparel 99.1
Person 98.8
Person 98.4
Person 97
Person 95.8
Dress 94.6
Costume 93.5
Shoe 90.7
Footwear 90.7
Dance Pose 89.5
Leisure Activities 89.5
Crowd 86.8
Female 86.6
Face 82.3
Person 81.7
Outdoors 79.2
Home Decor 78.3
Shorts 75
Festival 73.5
Portrait 72.6
Photography 72.6
Photo 72.6
Tie 69
Accessories 69
Accessory 69
People 68.7
Girl 66.5
Chair 66.5
Furniture 66.5
Shoe 66
Woman 65.3
Plant 63.9
Dance 61.8
Nature 61.8
Head 56.2
Performer 56
Overcoat 55.5
Suit 55.5
Coat 55.5

Clarifai
created on 2023-10-27

people 100
group 99.2
many 98.7
adult 96.7
woman 96.4
group together 96.1
child 95.8
man 95.1
several 93.6
wear 92.7
administration 92
outfit 91.3
dancing 90.4
boy 87.9
education 86.9
school 85.7
leader 83.9
music 83.8
medical practitioner 81.2
war 78.5

Imagga
created on 2022-01-23

people 24.5
metropolitan 19.4
man 18.1
world 17.8
person 17
male 16.3
clothing 16.1
adult 14
couple 13.9
old 13.2
portrait 12.9
statue 12.7
men 12
happiness 11.7
business 11.5
art 11.2
catholic 11.1
city 10.8
monument 10.3
church 10.2
two 10.2
religion 9.9
history 9.8
women 9.5
happy 9.4
architecture 9.4
tourism 9.1
dress 9
black 9
human 9
group 8.9
businessman 8.8
sculpture 8.7
wind instrument 8.7
bride 8.6
face 8.5
fashion 8.3
groom 8.1
uniform 8
family 8
indoors 7.9
love 7.9
scene 7.8
color 7.8
travel 7.7
musical instrument 7.7
culture 7.7
kin 7.7
god 7.7
faith 7.7
head 7.6
religious 7.5
traditional 7.5
life 7.5
wedding 7.4
tourist 7.3
room 7.2
building 7.2
holiday 7.2
hair 7.1
gown 7

Google
created on 2022-01-23

Black-and-white 82
Adaptation 79.3
Art 76.3
Snapshot 74.3
Monochrome photography 73.9
Event 73.6
Monochrome 73
Vintage clothing 70.2
Font 66.5
Photo caption 66.3
History 65.3
Room 65.1
Stock photography 63.6
Rite 59.9
Uniform 58.4
Picture frame 57.8
Team 56.3
Hat 53.7
Tradition 53.3
Visual arts 51.9

Microsoft
created on 2022-01-23

person 99.3
outdoor 89.8
clothing 88.8
sport 85.1
dance 81
group 80.1
standing 77.9
text 70.1
dancer 69
man 62.3
posing 40.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Male, 98.5%
Calm 66.3%
Fear 22%
Sad 6.4%
Surprised 3.2%
Happy 0.8%
Angry 0.6%
Disgusted 0.5%
Confused 0.2%

AWS Rekognition

Age 20-28
Gender Male, 88.9%
Calm 98.6%
Fear 0.5%
Disgusted 0.3%
Happy 0.2%
Surprised 0.2%
Confused 0.1%
Sad 0.1%
Angry 0%

AWS Rekognition

Age 21-29
Gender Female, 90.9%
Calm 78.6%
Sad 19.3%
Confused 0.7%
Angry 0.5%
Surprised 0.4%
Fear 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 35-43
Gender Male, 83.6%
Happy 96.3%
Sad 1.7%
Calm 1.4%
Confused 0.2%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 29-39
Gender Female, 71.4%
Calm 98.1%
Sad 1.2%
Happy 0.3%
Disgusted 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 90.7%
Tie 69%