Human Generated Data

Title

Untitled (man lying on bed with baby posed on his stomach)

Date

1948-1950

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9280

Human Generated Data

Title

Untitled (man lying on bed with baby posed on his stomach)

People

Artist: Martin Schweig, American 20th century

Date

1948-1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9280

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Furniture 99.8
Couch 96.7
Person 92.4
Human 92.4
Interior Design 87.4
Indoors 87.4
Bedroom 86.7
Room 86.7
Home Decor 70.8
Cushion 67.4
Bed 53.7

Clarifai
created on 2023-10-27

people 99.9
child 99.8
furniture 98.1
sit 97.2
adult 96.8
room 95.5
family 95.4
two 94.1
indoors 93.9
son 92.8
monochrome 92.7
woman 92.3
offspring 91.8
baby 91.4
man 91.1
one 91
bed 90.8
boy 89.7
war 87.9
reclining 84.9

Imagga
created on 2022-01-23

adult 36.2
person 34.9
people 31.8
sitting 29.2
male 29.2
man 28.4
happy 27.6
home 27.1
indoors 23.7
lifestyle 21.7
smiling 21
couple 20.9
senior 20.6
casual 19.5
couch 19.3
women 19
happiness 18.8
portrait 18.8
smile 17.8
chair 17.6
family 16.9
sofa 16.6
room 16.6
laptop 15.6
relaxing 15.5
cheerful 15.4
computer 15.3
seat 15.2
fun 15
mature 14.9
elderly 14.4
together 14
indoor 13.7
patient 13
looking 12.8
work 12.7
worker 12.5
leisure 12.4
old 11.8
child 11.7
working 11.5
living 11.4
mother 11.3
one 11.2
attractive 11.2
men 11.2
love 11
business 10.9
professional 10.9
lady 10.5
human 10.5
reading 10.5
adults 10.4
relaxed 10.3
grandfather 10.3
relax 10.1
book 10.1
alone 10
playing 10
house 10
aged 10
case 9.9
care 9.9
living room 9.8
retired 9.7
husband 9.7
office 9.6
retirement 9.6
life 9.3
relaxation 9.2
sick person 9.1
pensioner 9.1
health 9
armchair 8.9
furniture 8.9
father 8.8
brown hair 8.8
older 8.7
face 8.5
togetherness 8.5
two 8.5
modern 8.4
horizontal 8.4
joy 8.4
color 8.3
camera 8.3
parent 8.1
job 8
daughter 7.9
model 7.8
age 7.6
teacher 7.6
fashion 7.5
enjoyment 7.5
active 7.5
holding 7.4
technology 7.4
joyful 7.3
20s 7.3
executive 7.2
activity 7.2
table 7.1
day 7.1

Microsoft
created on 2022-01-23

bottle 82.3
text 77.3
black and white 67.8
person 54.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 97.2%
Surprised 33.9%
Sad 26.1%
Happy 13.5%
Calm 11.4%
Fear 7.3%
Disgusted 4.1%
Angry 2.6%
Confused 1%

AWS Rekognition

Age 18-26
Gender Male, 80.1%
Calm 51.8%
Sad 39.4%
Confused 2.7%
Happy 2.4%
Fear 1.8%
Angry 1.2%
Disgusted 0.5%
Surprised 0.3%

AWS Rekognition

Age 21-29
Gender Female, 75.6%
Calm 89.4%
Sad 4.4%
Happy 2%
Disgusted 1.3%
Angry 0.9%
Confused 0.8%
Surprised 0.6%
Fear 0.6%

AWS Rekognition

Age 23-31
Gender Female, 89.3%
Calm 77.9%
Sad 10.4%
Confused 4%
Happy 3.5%
Surprised 1.6%
Angry 1.1%
Disgusted 1%
Fear 0.6%

AWS Rekognition

Age 20-28
Gender Female, 75.4%
Calm 83.8%
Sad 6.6%
Angry 2.6%
Confused 2%
Disgusted 1.9%
Happy 1.6%
Surprised 0.9%
Fear 0.7%

AWS Rekognition

Age 21-29
Gender Female, 75.6%
Calm 91.3%
Sad 3.1%
Happy 2.2%
Angry 1.6%
Confused 0.6%
Surprised 0.6%
Disgusted 0.5%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 92.4%
Bed 53.7%

Text analysis

Amazon

003