Human Generated Data

Title

Untitled (mother with two daughters in matching dresses)
Date

c. 1945
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1444

Human Generated Data

Title

Untitled (mother with two daughters in matching dresses)

People

Artist: Martin Schweig, American 20th century

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1444

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.6
Person 99.6
Person 99.6
Person 99
People 97.8
Family 96.9
Person 94
Female 84.8
Girl 75.4
Couch 74.2
Furniture 74.2
Clothing 70.6
Apparel 70.6
Face 67.4
Woman 59.9
Photo 56.6
Photography 56.6
Child 56.2
Kid 56.2

Clarifai
created on 2023-10-26

people 99.9
child 99.6
group 99.5
portrait 99.5
three 99.4
family 99
offspring 98.8
sibling 98.6
four 98.6
son 98.4
monochrome 97.9
facial expression 96.6
adult 96.2
two 96.2
woman 92.8
nostalgia 92.6
man 90.7
sit 90.6
group together 88.9
retro 88.7

Imagga
created on 2022-01-22

happy 38.2
couple 35.7
people 35.1
male 34.8
man 32.9
home 32.7
family 32
mother 31
smiling 30.4
adult 27.5
kin 26.7
together 26.3
person 25.2
sitting 23.2
parent 23
child 22
smile 21.4
father 20.5
husband 20.2
sibling 20
love 19.7
attractive 19.6
lifestyle 19.5
two 19.5
indoors 19.3
fun 18.7
casual 18.6
women 17.4
wife 17.1
brother 16.9
computer 16.8
portrait 16.8
boy 16.5
happiness 16.4
couch 16.4
men 16.3
senior 15.9
daughter 15.5
looking 15.2
playing 14.6
cheerful 13.8
room 12.9
indoor 12.8
handsome 12.5
leisure 11.6
interior 11.5
cute 11.5
loving 11.4
togetherness 11.3
world 11.3
laptop 10.9
retired 10.7
face 10.7
dad 10.6
30s 10.6
elderly 10.5
group 10.5
old 10.4
black 10.3
son 10.3
mature 10.2
teen 10.1
20s 10.1
teenager 10
kid 9.7
married 9.6
active 9.6
jeans 9.6
table 9.5
sit 9.5
grandma 9.4
domestic 9.2
house 9.2
color 8.9
retirement 8.6
play 8.6
expression 8.5
enjoying 8.5
youth 8.5
meeting 8.5
friends 8.5
pretty 8.4
horizontal 8.4
grandfather 8.3
girls 8.2
children 8.2
brunette 7.8
grandmother 7.8
standing 7.8
clothing 7.8
hug 7.7
living 7.6
adults 7.6
pair 7.6
school 7.5
life 7.3
business 7.3
businesswoman 7.3
kitchen 7.2
game 7.1
classroom 7.1
work 7.1
day 7.1

Google
created on 2022-01-22

Photograph 94.3
Smile 91.7
Black 89.7
Picture frame 76.3
Vintage clothing 76
Classic 74.6
Snapshot 74.3
Event 73.8
Jewellery 72.1
Fun 69.5
Necklace 63.5
History 62.5
Happy 61.8
Stock photography 61.7
Monochrome 61.6
Room 59.3
Sitting 58.4
Retro style 57.2
Monochrome photography 57.1
Family 55.7

Microsoft
created on 2022-01-22

text 99.8
person 99.2
clothing 98.8
human face 98.8
smile 98.4
wall 98.1
posing 90
woman 85.8
old 78.1
people 71

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Female, 100%
Happy 58.4%
Calm 36.2%
Confused 2.1%
Angry 1.2%
Surprised 0.7%
Disgusted 0.7%
Sad 0.5%
Fear 0.2%

AWS Rekognition

Age 31-41
Gender Female, 100%
Happy 96.7%
Calm 0.7%
Surprised 0.6%
Sad 0.6%
Fear 0.6%
Confused 0.4%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 12-20
Gender Female, 99.9%
Calm 96.7%
Happy 2.2%
Confused 0.3%
Angry 0.3%
Sad 0.2%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 6-14
Gender Female, 79.1%
Calm 86.1%
Angry 8%
Happy 2.5%
Sad 2%
Disgusted 0.4%
Surprised 0.4%
Fear 0.3%
Confused 0.3%

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 17
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Categories

Imagga

people portraits 99.6%

Text analysis

Amazon

Studio
Schweig Studio Proof
Schweig
Proof
softer
feature
out jew

Google

Schweig Studio Proof
Schweig
Studio
Proof