Human Generated Data

Title

Untitled (older couple posed sitting on couch with younger woman and small boy)

Date

1941

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10232

Human Generated Data

Title

Untitled (older couple posed sitting on couch with younger woman and small boy)

People

Artist: Martin Schweig, American 20th century

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10232

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.8
Human 99.8
Person 99.7
Person 98.9
Family 97.6
People 97.6
Person 96.8
Suit 96
Clothing 96
Coat 96
Overcoat 96
Apparel 96
Tie 84
Accessories 84
Accessory 84
Couch 71.4
Furniture 71.4
Sitting 66.3

Clarifai
created on 2023-10-26

people 99.9
group 99.4
three 98.3
portrait 97.8
man 97.4
leader 97.3
adult 96.7
two 96.3
four 95.7
family 95.6
offspring 95.3
sepia 93.2
child 92.5
administration 92.2
nostalgia 91.7
chair 90.3
woman 90
group together 89.2
retro 85.3
sit 84.4

Imagga
created on 2022-01-22

kin 73.8
senior 41.2
home 37.5
people 35.1
man 34.9
male 33.3
elderly 30.6
couple 30.5
family 30.2
person 29.8
happy 29.4
adult 26.9
mature 25.1
old 22.3
mother 21.5
portrait 21.3
grandfather 20.3
men 19.7
retired 19.4
indoors 19.3
smile 19.2
lifestyle 18.8
together 18.4
grandma 18.3
retirement 18.2
sitting 18
happiness 18
smiling 17.4
aged 17.2
cheerful 15.4
husband 15.3
love 15
face 14.9
older 14.6
indoor 13.7
two 13.5
room 13
grandmother 12.7
women 12.6
care 12.3
parent 12
business 11.5
medical 11.5
lady 11.4
group 11.3
daughter 11.1
70s 10.8
couch 10.6
father 10.6
human 10.5
health 10.4
child 10.1
professional 10.1
60s 9.8
interior 9.7
pensioner 9.6
married 9.6
boy 9.6
age 9.5
enjoying 9.5
meeting 9.4
day 9.4
relationship 9.4
help 9.3
horizontal 9.2
inside 9.2
dress 9
active 9
fun 9
caring 8.8
office 8.8
looking 8.8
30s 8.7
wife 8.5
adults 8.5
females 8.5
businessman 7.9
seniors 7.9
antique 7.8
middle aged 7.8
affectionate 7.7
clothing 7.6
loving 7.6
casual 7.6
illness 7.6
marriage 7.6
fashion 7.5
joy 7.5
friends 7.5
leisure 7.5
vintage 7.4
glasses 7.4
blond 7.2
bow tie 7.1
romantic 7.1
executive 7.1
kid 7.1
to 7.1
look 7

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 100
clothing 98.7
sitting 98.6
human face 98.6
smile 98.3
text 93.9
old 93.9
baby 88.7
black 87.2
group 85.2
people 83.2
woman 77.9
man 63.5
posing 63.4
toddler 63.4
vintage 32.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-64
Gender Male, 98.9%
Calm 95.1%
Happy 4.3%
Confused 0.2%
Angry 0.1%
Sad 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 100%
Happy 98.1%
Calm 0.8%
Surprised 0.3%
Angry 0.2%
Disgusted 0.2%
Confused 0.2%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 0-3
Gender Female, 98.7%
Calm 55.1%
Happy 27.4%
Surprised 6.2%
Confused 5.2%
Angry 2.6%
Disgusted 2.5%
Sad 0.5%
Fear 0.3%

AWS Rekognition

Age 63-73
Gender Male, 97.2%
Calm 86.4%
Angry 12.1%
Sad 0.4%
Disgusted 0.3%
Confused 0.3%
Surprised 0.2%
Fear 0.2%
Happy 0.1%

Microsoft Cognitive Services

Age 63
Gender Male

Microsoft Cognitive Services

Age 53
Gender Male

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Suit 96%
Tie 84%

Categories

Imagga

people portraits 94.3%
paintings art 5.6%

Text analysis

Amazon

PROOF
MARTIN
MARTIN SCHWEIG
SCHWEIG

Google

PROOF MARTIN SCHWEIG
PROOF
MARTIN
SCHWEIG