Human Generated Data

Title

Untitled (bride and large wedding party posing in large room with couches and table)

Date

c. 1940-1960

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9902

Human Generated Data

Title

Untitled (bride and large wedding party posing in large room with couches and table)

People

Artist: Martin Schweig, American 20th century

Date

c. 1940-1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 98.3
Human 98.3
Person 96.2
Person 95.6
Person 95.3
Person 92.3
Person 88.6
Person 88.5
Person 88.5
Person 87.3
People 84.1
Person 83.4
Room 82.8
Indoors 82.8
Clothing 77.5
Apparel 77.5
Person 74.9
Living Room 65.9
Face 61.1
Photography 60
Photo 60
Furniture 58.3
Urban 57.9
Stage 57.1
Person 42.7

Imagga
created on 2022-01-28

teacher 31.8
man 30.9
people 27.3
classroom 23.9
person 22
adult 21.1
male 20.7
room 20.1
group 18.5
education 18.2
men 16.3
school 15.9
world 15.4
musical instrument 15.2
educator 15
hand 14.4
business 14
professional 13.9
happy 13.8
holding 13.2
active 13.1
child 13
youth 12.8
interior 12.4
businessman 12.3
lifestyle 12.3
student 12.2
board 11.9
indoor 11.9
team 11.6
blackboard 11.6
smile 11.4
portrait 11
smiling 10.8
to 10.6
class 10.6
human 9.7
fun 9.7
black 9.6
women 9.5
drawing 9.4
happiness 9.4
sport 9.2
building 9.2
silhouette 9.1
wind instrument 8.9
indoors 8.8
boy 8.7
play 8.6
two 8.5
study 8.4
floor 8.4
color 8.3
hospital 8.3
cheerful 8.1
kin 7.9
together 7.9
guitar 7.8
motion 7.7
crowd 7.7
stage 7.6
joy 7.5
city 7.5
teen 7.3
lady 7.3
girls 7.3
success 7.2
music 7.2
job 7.1
travel 7
modern 7

Google
created on 2022-01-28

Chair 83.5
Art 76.3
Room 65.1
Painting 64
Monochrome 63.2
Visual arts 62.9
Event 62.3
Sitting 62
History 62
Vintage clothing 60.2
Class 55
Font 52.3

Microsoft
created on 2022-01-28

text 98.7
person 86.7
clothing 68.9
group 55.9

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Female, 74.6%
Happy 68.8%
Calm 14.2%
Sad 10.2%
Surprised 2.8%
Confused 1.7%
Angry 1.1%
Disgusted 0.8%
Fear 0.3%

AWS Rekognition

Age 35-43
Gender Male, 97.5%
Sad 35.8%
Calm 20.2%
Confused 13.7%
Fear 13%
Happy 9.9%
Disgusted 4.5%
Surprised 1.9%
Angry 1%

AWS Rekognition

Age 23-31
Gender Male, 99.4%
Sad 84.6%
Calm 8.7%
Confused 4.9%
Angry 0.6%
Surprised 0.4%
Disgusted 0.4%
Fear 0.3%
Happy 0.2%

AWS Rekognition

Age 36-44
Gender Female, 69.1%
Calm 48%
Confused 21.3%
Sad 20.8%
Happy 5.1%
Disgusted 2.6%
Surprised 0.9%
Angry 0.8%
Fear 0.5%

AWS Rekognition

Age 48-56
Gender Male, 95.1%
Sad 69.3%
Calm 19.3%
Happy 6.4%
Confused 2.8%
Disgusted 0.9%
Surprised 0.5%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 23-31
Gender Male, 95.9%
Calm 94.4%
Sad 3.1%
Happy 1.3%
Angry 0.4%
Confused 0.3%
Disgusted 0.2%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 11-19
Gender Male, 70.4%
Calm 82.6%
Sad 11%
Confused 2%
Happy 1.8%
Angry 1.3%
Disgusted 0.6%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 26-36
Gender Male, 95.7%
Sad 83%
Calm 5.6%
Confused 3.6%
Happy 3%
Disgusted 2.1%
Angry 1.4%
Fear 0.6%
Surprised 0.6%

AWS Rekognition

Age 42-50
Gender Male, 93.3%
Sad 48.9%
Calm 42.6%
Fear 4.5%
Confused 1.2%
Disgusted 1%
Surprised 0.9%
Angry 0.5%
Happy 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%

Captions

Microsoft

a group of people standing in front of a building 77.5%
a group of people around each other 77.4%
a group of people posing for a photo 76.6%

Text analysis

Amazon

24551