Human Generated Data

Title

Untitled (two older couples posed with three young children in their laps in living room)
Date

1953
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9480

Human Generated Data

Title

Untitled (two older couples posed with three young children in their laps in living room)

People

Artist: Martin Schweig, American 20th century

Date

1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 99.6
Clothing 99.6
Person 98.9
Human 98.9
Person 98.9
Person 98.8
Person 98.3
Person 98.2
Person 97.8
Shorts 94.3
Female 94.2
Furniture 89.8
Dress 87.8
Chair 87.4
Skirt 84.9
Indoors 82.8
Face 82.2
Living Room 79.7
Room 79.7
People 78.6
Woman 78.3
Girl 74.3
Kid 74
Child 74
Couch 68.5
Footwear 67.5
Shoe 67.5
Baby 66
Overcoat 61.7
Coat 61.7
Suit 61.7
Photography 61.2
Photo 61.2
Cabinet 56.5

Imagga
created on 2022-01-23

person 30.3
man 26.9
people 26.8
adult 21.3
male 19.9
teacher 18.2
group 16.9
men 15.4
professional 15.1
world 15
child 14.7
kin 14.4
happy 14.4
life 13.8
team 13.4
smiling 13
portrait 12.9
girls 12.8
sibling 12.7
women 12.6
sport 12.5
business 12.1
educator 11.7
performer 11.3
couple 11.3
dancer 11.1
family 10.7
interior 10.6
cheerful 10.6
crowd 10.6
fashion 10.5
dance 10.5
human 10.5
happiness 10.2
shop 10.2
silhouette 9.9
businessman 9.7
together 9.6
black 9.6
home 9.6
work 9.5
smile 9.3
pretty 9.1
attractive 9.1
holding 9.1
childhood 8.9
job 8.8
standing 8.7
cute 8.6
youth 8.5
casual 8.5
fun 8.2
children 8.2
musician 8.1
sexy 8
indoors 7.9
urban 7.9
bright 7.9
active 7.8
entertainer 7.8
motion 7.7
old 7.7
ball 7.6
head 7.5
singer 7.5
friends 7.5
friendship 7.5
city 7.5
traditional 7.5
teamwork 7.4
nurse 7.4
clothing 7.3
blackboard 7.2
lifestyle 7.2
worker 7.2
art 7.1
love 7.1

Google
created on 2022-01-23

Smile 91.1
Black-and-white 84.4
Dress 84.3
Style 83.8
Snapshot 74.3
Vintage clothing 71.5
Monochrome photography 71.2
Monochrome 71
Fun 70.6
Room 68.6
Event 66.9
Shorts 65.8
Classic 64.2
Stock photography 63.3
Pattern 62.5
History 62.5
Font 61.4
Team 61.3
Photo caption 57.4
Sitting 57.4

Microsoft
created on 2022-01-23

person 98.4
clothing 95.7
text 92.4
smile 76.9
footwear 69.1
posing 66.1

Face analysis

Amazon

Google

AWS Rekognition

Age 54-62
Gender Male, 100%
Sad 90.1%
Happy 2.6%
Confused 2.4%
Angry 2.1%
Disgusted 0.9%
Surprised 0.7%
Fear 0.7%
Calm 0.4%

AWS Rekognition

Age 48-54
Gender Male, 98.9%
Happy 84.4%
Sad 11.6%
Disgusted 0.9%
Calm 0.9%
Confused 0.7%
Angry 0.7%
Fear 0.4%
Surprised 0.4%

AWS Rekognition

Age 23-31
Gender Female, 99.3%
Happy 51.1%
Surprised 18.5%
Fear 13.8%
Calm 11.4%
Sad 2.5%
Angry 1.4%
Disgusted 1%
Confused 0.2%

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 70.2%
Surprised 7.2%
Happy 5.6%
Fear 5.1%
Sad 3.9%
Angry 3.1%
Confused 2.9%
Disgusted 1.9%

AWS Rekognition

Age 48-54
Gender Male, 99.7%
Surprised 95.7%
Happy 2.6%
Calm 0.5%
Fear 0.4%
Confused 0.3%
Disgusted 0.2%
Sad 0.2%
Angry 0.1%

AWS Rekognition

Age 27-37
Gender Male, 99.7%
Surprised 56.3%
Happy 21%
Calm 14.4%
Fear 5.7%
Sad 1.3%
Angry 0.5%
Disgusted 0.5%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Shoe 67.5%

Captions

Microsoft

a group of people posing for a photo 97.1%
a group of people posing for the camera 97%
a group of people posing for a picture 96.9%

Text analysis

Google

S
8 3 S e
3
e
8