Human Generated Data

Title

Untitled (couple in day clothes posing in front of foliage and candelabra)
Date

1941
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10233

Human Generated Data

Title

Untitled (couple in day clothes posing in front of foliage and candelabra)

People

Artist: Martin Schweig, American 20th century

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99.8
Apparel 99.8
Person 99.5
Human 99.5
Tie 97.9
Accessories 97.9
Accessory 97.9
Person 95.2
Overcoat 95
Coat 92.5
Skirt 88
Female 86.6
Tuxedo 82.8
Shoe 79.1
Footwear 79.1
Plant 76.1
Flower 68.4
Blossom 68.4
Jewelry 66.9
Woman 66.4
Suit 64.4
Girl 63.3
People 62
Gown 60.6
Fashion 60.6
Robe 60.2
Dress 57.7
Evening Dress 57.1
Shoe 53.4

Imagga
created on 2022-01-22

people 27.9
man 26.9
male 26.4
person 26
adult 25.4
clothing 23.5
coat 22
standing 21.7
uniform 21.7
military uniform 19.6
attractive 18.2
portrait 18.1
trench coat 18.1
happy 17.5
smile 17.1
garment 16.6
professional 16.5
suit 15.5
raincoat 15.5
business 15.2
fashion 15.1
couple 14.8
lifestyle 13.7
black 13.4
men 12.9
pretty 12.6
waiter 12.2
lady 12.2
dress 11.7
businessman 11.5
one 11.2
looking 11.2
corporate 11.2
casual 11
confident 10.9
bow tie 10.8
job 10.6
sexy 10.4
office 10.4
career 10.4
style 10.4
home 10.4
women 10.3
child 10.2
face 9.9
holding 9.9
building 9.8
urban 9.6
body 9.6
brunette 9.6
boy 9.6
smiling 9.4
expression 9.4
worker 9.4
street 9.2
outdoor 9.2
alone 9.1
businesswoman 9.1
dining-room attendant 9
cheerful 8.9
happiness 8.6
cute 8.6
necktie 8.6
model 8.6
youth 8.5
shirt 8.4
city 8.3
student 8.1
handsome 8
family 8
posing 8
interior 8
room 8
vertical 7.9
covering 7.8
girlfriend 7.7
old 7.7
two 7.6
door 7.6
fashionable 7.6
stand 7.6
school 7.5
jacket 7.5
employee 7.5
executive 7.5
occupation 7.3
consumer goods 7.3
success 7.2
love 7.1
indoors 7
modern 7
together 7
look 7

Google
created on 2022-01-22

Coat 88.5
Picture frame 83.8
Smile 82.9
Collar 82.2
Blazer 78.1
Suit 78
Formal wear 74.9
Vintage clothing 73.4
Classic 70.7
Sleeve 68.4
Uniform 67.4
Event 65.2
Stock photography 62.4
Pattern 61.2
History 60.5
Tie 58.7
Tree 58.4
Retro style 56.4
Military person 54.4
Fashion design 52.5

Microsoft
created on 2022-01-22

text 99.6
posing 98.4
person 98.4
standing 97.9
dress 93.2
suit 92.7
woman 92.6
clothing 89.8
old 88.6
smile 78.7
white 78
black 76.7
clothes 17.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-46
Gender Male, 100%
Calm 97.4%
Happy 0.9%
Confused 0.6%
Surprised 0.5%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 31-41
Gender Female, 100%
Happy 49.3%
Fear 17.9%
Calm 11%
Angry 7.4%
Surprised 5%
Confused 3.9%
Sad 2.7%
Disgusted 2.7%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 35
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 97.9%
Coat 92.5%
Skirt 88%
Shoe 79.1%
Suit 64.4%

Captions

Microsoft

a vintage photo of Zog I of Albania standing in front of a building 96.3%
Zog I of Albania et al. posing for a photo 94.4%
Zog I of Albania and woman posing for a photo 92.7%

Text analysis

Amazon

PROOF
ARTIN
LOUIS
SAINT LOUIS
SAINT
ARTIN SCHWEIG
SCHWEIG
to
frair to
ron
darken
show ron
show
frair

Google

darlem hain to PROOF ARTIN SCHWEIG SAINT LOUIS
darlem
hain
to
PROOF
ARTIN
SCHWEIG
SAINT
LOUIS