Human Generated Data

Title

Untitled (studio portrait of young girl with man in military jacket)

Date

1942

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10215

Human Generated Data

Title

Untitled (studio portrait of young girl with man in military jacket)

People

Artist: Martin Schweig, American 20th century

Date

1942

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 98.6
Human 98.6
Person 98.6
Officer 87.6
Military 87.6
Military Uniform 87.6
Coat 67.4
Overcoat 67.4
Apparel 67.4
Suit 67.4
Clothing 67.4

Imagga
created on 2022-01-22

child 52
family 49.9
mother 47.2
parent 46.6
happy 42.7
male 42.5
people 35.7
father 35.4
love 34.8
couple 34
sibling 33.5
home 32.7
man 32.3
daughter 32
together 30.7
happiness 30.6
smiling 29.7
dad 27.4
son 25.7
portrait 25.3
husband 24.8
kin 24.3
kid 24
adult 23.9
smile 23.5
lifestyle 22.4
senior 20.6
casual 20.4
baby 20.2
joy 19.2
wife 19
cute 18.7
indoors 18.5
fun 18
two 17.8
mature 17.7
boy 17.4
cheerful 17.1
grandma 17
brother 15.7
married 15.4
elderly 15.3
person 15.1
women 15
children 14.6
30s 14.4
grandfather 14.4
childhood 14.3
togetherness 14.2
little 14.1
relationship 14.1
holding 14
room 13.7
old 13.3
face 12.1
attractive 11.9
playing 11.9
hug 11.6
care 11.5
loving 11.5
laughing 11.4
adorable 11.1
girls 10.9
leisure 10.8
half length 10.7
retired 10.7
interior 10.6
looking 10.4
men 10.3
joyful 10.1
clothing 9.9
grandmother 9.8
parents 9.8
hugging 9.8
thirties 9.7
newborn 9.7
offspring 9.7
affectionate 9.7
infant 9.7
living 9.5
enjoying 9.5
females 9.5
sitting 9.5
life 9.4
pretty 9.1
human 9
generations 8.9
cuddling 8.9
group 8.9
medical 8.8
living room 8.8
embracing 8.8
two people 8.8
mom 8.7
blond 8.7
day 8.6
illness 8.6
youth 8.5
adults 8.5
friends 8.5
black 8.4
horizontal 8.4
color 8.3
camera 8.3
dress 8.1
new 8.1
standing 7.8
aging 7.7
health 7.6
studio 7.6
hand 7.6
pair 7.6
house 7.5
emotion 7.4
aged 7.2
romantic 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 99.9
human face 98.9
wall 98.4
text 95
clothing 94
indoor 93.8
posing 83.1
girl 79.8
portrait 56.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 96.6%
Confused 1.4%
Angry 0.8%
Happy 0.8%
Surprised 0.2%
Sad 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 4-10
Gender Female, 100%
Calm 98.4%
Angry 0.5%
Sad 0.4%
Confused 0.3%
Disgusted 0.1%
Surprised 0.1%
Fear 0%
Happy 0%

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Suit 67.4%

Captions

Microsoft

a boy and girl posing for a photo 85.2%
a little girl posing for a photo 85.1%
a group of people posing for the camera 85%

Text analysis

Amazon

THE
PROC
x
THIS PROC
THIS
5
xxx x x x x 2
5 THE PROVERTY
xxx
STA
OKIC STA
PROVERTY
2
OKIC

Google

PRO
STHE PRO RTY
RTY
STHE