Human Generated Data

Title

Untitled (group portrait)
Date

c. 1920
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.725

Human Generated Data

Title

Untitled (group portrait)

People

Artist: Martin Schweig, American 20th century

Date

c. 1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.6
Human 99.6
Person 99.3
Person 98.7
People 96.4
Family 95.1
Shoe 94.9
Clothing 94.9
Footwear 94.9
Apparel 94.9
Person 93.7
Shoe 93.5
Door 65.4
Pants 63.1
Sitting 58.4
Furniture 56.4
Photography 55.8
Photo 55.8
Suit 55.4
Coat 55.4
Overcoat 55.4

Imagga
created on 2022-01-08

kin 73.9
couple 31.4
man 26.2
adult 26.1
home 24.7
love 24.5
people 24
portrait 23.3
sitting 22.3
person 22.2
attractive 21.7
happy 21.3
male 20.8
happiness 20.4
room 18.5
couch 18.4
sofa 18.2
family 16.9
sexy 16.9
mother 15.2
fashion 15.1
indoors 14.9
pretty 14.7
indoor 14.6
smiling 14.5
lifestyle 14.5
two 14.4
face 13.5
hair 13.5
women 13.4
interior 13.3
model 13.2
cheerful 13
groom 12.9
casual 11.9
bride 11.7
husband 11.7
lady 11.4
old 11.2
house 10.9
dress 10.8
smile 10.7
together 10.5
parent 10.5
living 10.4
style 10.4
wedding 10.1
father 9.9
living room 9.8
clothing 9.6
men 9.4
child 9.4
cute 9.3
elegance 9.2
gorgeous 9.1
aged 9.1
life 9
history 8.9
posing 8.9
chair 8.8
statue 8.8
ancient 8.7
married 8.6
comfortable 8.6
architecture 8.6
loving 8.6
passion 8.5
monument 8.4
vintage 8.3
historic 8.3
tourism 8.2
sensual 8.2
religion 8.1
handsome 8
romantic 8
looking 8
sculpture 7.9
art 7.9
brunette 7.8
boy 7.8
color 7.8
apartment 7.7
wife 7.6
historical 7.5
senior 7.5
relationship 7.5
fun 7.5
holding 7.4
dad 7.2
body 7.2
domestic 7.2
romance 7.1

Google
created on 2022-01-08

Shoe 95.8
Adaptation 79.3
Tints and shades 77.3
Vintage clothing 76
Monochrome 74.4
Classic 73.8
Sitting 71.9
Monochrome photography 70.9
Room 69.5
Knee 69.3
Boot 67.5
Flash photography 66.3
Chair 65.6
Stock photography 63
History 62.9
Retro style 57.7
Portrait 56.3
Photographic paper 54.5
Fun 53
Visual arts 52.5

Microsoft
created on 2022-01-08

clothing 99.5
person 98.9
smile 98.1
human face 98
wall 96.6
text 96
footwear 93.9
woman 80.6
child 76.3
posing 67.8
old 65.1
boy 57.9
family 26.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-24
Gender Female, 95.9%
Calm 99.7%
Sad 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 6-16
Gender Male, 99.8%
Calm 99.6%
Confused 0.2%
Angry 0.1%
Surprised 0%
Sad 0%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 2-10
Gender Female, 99.9%
Calm 99.8%
Sad 0%
Angry 0%
Confused 0%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 11-19
Gender Female, 100%
Calm 99.3%
Happy 0.4%
Surprised 0.1%
Angry 0.1%
Confused 0%
Sad 0%
Fear 0%
Disgusted 0%

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 21
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 94.9%
Suit 55.4%

Captions

Microsoft

a group of people sitting posing for the camera 97.5%
a group of people sitting posing for a photo 96.7%
a group of people posing for a photo 96.5%

Text analysis

Amazon

SCHWEIG
ST.LOUIS.

Google

SCHWEIG ST. LOUIS
SCHWEIG
ST.
LOUIS