Human Generated Data

Title

Mr. and Mrs. Coleman in Front of Barn Door, Sharon Springs, New York
Date

1969-1972
People

Artist: Hansi Durlach, American born 1930
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Artist, P1999.11

Human Generated Data

Title

Mr. and Mrs. Coleman in Front of Barn Door, Sharon Springs, New York

People

Artist: Hansi Durlach, American born 1930

Date

1969-1972

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Clothing 99.6
Apparel 99.6
Person 99.5
Human 99.5
Person 99.3
Sleeve 99.3
Long Sleeve 87.7
Shoe 64.9
Footwear 64.9
Overcoat 61.2
Coat 61.2
Home Decor 61.1
Door 58.7
Shorts 57.3
Female 56

Imagga
created on 2021-12-14

people 30.1
person 28.8
clothing 27.9
adult 26.9
man 25.5
happy 24.4
male 22.7
portrait 22.6
fashion 22.6
attractive 22.4
couple 20
business 18.8
pretty 18.2
dress 17.2
lady 17
sexy 16.9
holding 16.5
smile 15.7
happiness 15.7
garment 15.2
smiling 14.5
bow tie 13.8
casual 13.5
umbrella 13
lifestyle 13
life 12.5
handsome 12.5
family 12.4
model 12.4
clothes 12.2
covering 12
day 11.8
suit 11.8
full length 11.6
businessman 11.5
adults 11.3
looking 11.2
love 11
necktie 10.7
face 10.6
modern 10.5
bag 10.5
body 10.4
corporate 10.3
elegance 10.1
human 9.7
urban 9.6
brunette 9.6
women 9.5
walking 9.5
men 9.4
cute 9.3
emotion 9.2
shopping 9.2
old 9.1
one 9
shop 8.8
bags 8.8
coat 8.7
standing 8.7
bride 8.6
elegant 8.6
industry 8.5
outdoor 8.4
professional 8.4
nice 8.2
makeup 8.2
worker 8.2
black 8.1
lovely 8
posing 8
interior 8
look 7.9
buying 7.7
door 7.6
stand 7.6
canopy 7.4
hold 7.4
indoor 7.3
hair 7.1

Google
created on 2021-12-14

Photograph 94.2
Black 89.8
Sleeve 86.6
Style 83.8
Black-and-white 82.8
Collar 81
Tints and shades 76.8
One-piece garment 76
Fashion design 72.9
Monochrome photography 72.7
Monochrome 70.5
Vintage clothing 69.9
Event 69.5
Rectangle 65.8
Formal wear 64.9
Stock photography 62.6
History 60
Classic 59.9
Pattern 58.6
Photography 52.5

Microsoft
created on 2021-12-14

person 99.7
standing 98.7
text 95
outdoor 93.8
clothing 93.6
black and white 91.1
posing 90.8
smile 88
black 80.8
old 69.8
white 60.4
human face 55.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-66
Gender Male, 97.6%
Calm 45.5%
Angry 18.3%
Sad 13.3%
Confused 11.6%
Disgusted 4.9%
Fear 3.8%
Surprised 1.9%
Happy 0.7%

AWS Rekognition

Age 49-67
Gender Female, 98.8%
Calm 79.8%
Sad 11.7%
Confused 4.8%
Angry 1.8%
Happy 0.6%
Disgusted 0.4%
Surprised 0.4%
Fear 0.4%

Microsoft Cognitive Services

Age 67
Gender Female

Microsoft Cognitive Services

Age 59
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a man and a woman standing in front of a building 90.9%
a person standing in front of a building 90.8%
a man and a woman posing for a photo 90.4%