Human Generated Data

Title

Untitled (proof print: woman and girl flanked by older couple)
Date

1950s
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14107

Human Generated Data

Title

Untitled (proof print: woman and girl flanked by older couple)

People

Artist: Martin Schweig, American 20th century

Date

1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14107

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.3
Human 99.3
Person 98.7
Person 97.9
Person 96
People 95.8
Family 93.1
Suit 85.9
Coat 85.9
Overcoat 85.9
Clothing 85.9
Apparel 85.9
Suit 79.8
Crowd 63.3
Tie 57.3
Accessories 57.3
Accessory 57.3

Clarifai
created on 2023-10-26

people 100
group 99.9
portrait 99.1
three 98.7
administration 98.5
adult 98.3
wear 98.1
four 98
leader 96.6
actor 96.4
offspring 96.2
nostalgia 95.9
monochrome 95.9
man 95.9
group together 95.5
actress 94.7
retro 93.9
facial expression 91.1
woman 90.5
movie 90.3

Imagga
created on 2022-01-22

kin 74.7
man 38.3
people 33.5
senior 30.9
male 29.2
person 29
adult 26.1
home 24.7
happy 24.4
nurse 22.6
couple 21.8
indoors 21.1
businessman 20.3
group 20.2
business 20
businesswoman 20
smiling 19.5
mature 19.5
colleagues 19.4
elderly 19.2
men 18.9
team 18.8
meeting 17.9
professional 17.7
medical 17.7
30s 17.3
businesspeople 17.1
office 16.9
hospital 16.1
doctor 16
happiness 14.9
portrait 14.9
mother 14.6
lifestyle 14.5
family 14.2
old 13.9
health 13.9
cheerful 13.8
patient 13.7
retired 13.6
inside 12.9
husband 12.5
job 12.4
bow tie 12.4
together 12.3
teamwork 12.1
20s 11.9
room 11.9
indoor 11.9
coworkers 11.8
discussion 11.7
retirement 11.5
care 11.5
talking 11.4
smile 11.4
standing 11.3
sitting 11.2
camera 11.1
discussing 10.8
clothing 10.8
40s 10.7
thirties 10.7
illness 10.5
casual 10.2
horizontal 10.1
working 9.7
women 9.5
wife 9.5
career 9.5
corporate 9.5
work 9.4
two 9.3
face 9.2
worker 9.2
grandma 9
necktie 9
70s 8.9
forties 8.8
medicine 8.8
businessmen 8.8
child 8.8
middle aged 8.8
two people 8.8
cooperation 8.7
love 8.7
partnership 8.6
sibling 8.5
attractive 8.4
occupation 8.2
grandfather 8.2
aged 8.1
computer 8
daughter 8
explaining 7.9
seniors 7.9
brunette 7.8
color 7.8
stethoscope 7.8
older 7.8
sick 7.7
mid adult 7.7
busy 7.7
married 7.7
four 7.7
clinic 7.7
females 7.6
coat 7.5
pensioner 7.5
presentation 7.4
successful 7.3
friendly 7.3
uniform 7.3
success 7.2
looking 7.2
to 7.1

Google
created on 2022-01-22

Hairstyle 95.1
Photograph 94.2
Coat 88.3
Dress 84.2
Chair 78.9
Suit 76.4
Vintage clothing 74.6
Snapshot 74.3
Classic 73.5
Event 72.1
Formal wear 68.2
Tie 65.5
Monochrome 65.4
Stock photography 64.1
Sitting 64.1
History 61.8
Fashion design 58.6
Retro style 57.7
Day dress 57
Family pictures 56.6

Microsoft
created on 2022-01-22

person 100
clothing 98.9
human face 98
smile 96.3
people 89
group 86.4
old 85.7
text 84.3
woman 83.4
man 73
black 65.6
posing 65.1
white 62.8
retro 58.2
vintage 33.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-54
Gender Female, 100%
Calm 67.9%
Surprised 11.7%
Confused 9.5%
Angry 5.4%
Happy 2.5%
Disgusted 1.5%
Sad 0.9%
Fear 0.6%

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Calm 100%
Surprised 0%
Angry 0%
Happy 0%
Confused 0%
Sad 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 25-35
Gender Female, 99.8%
Calm 99.2%
Surprised 0.2%
Sad 0.2%
Happy 0.1%
Angry 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 6-14
Gender Female, 100%
Calm 99.9%
Sad 0.1%
Surprised 0%
Confused 0%
Fear 0%
Angry 0%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 55
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 18
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Suit 85.9%
Tie 57.3%

Categories

Imagga

people portraits 99.9%

Text analysis

Amazon

PROOF
MARTIN
SAINT
SAINT LOUIS
LOUIS
MARTIN SCHWEIG
SCHWEIG
folds
M
Softex folds
Softex

Google

bafter, I PROOF MARTIN SCHWEIG SAINT LQUIS
bafter,
I
PROOF
MARTIN
SCHWEIG
SAINT
LQUIS