Human Generated Data

Title

Untitled (man and two women at party)

Date

1965

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19315

Human Generated Data

Title

Untitled (man and two women at party)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1965

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Clothing 98.8
Apparel 98.8
Person 98.6
Human 98.6
Sleeve 97.8
Person 94.3
Person 94.2
Long Sleeve 93.1
Suit 85.9
Overcoat 85.9
Coat 85.9
Pants 85.6
Gown 77.8
Evening Dress 77.8
Robe 77.8
Fashion 77.8
Poster 60.3
Advertisement 60.3
Door 55.2

Imagga
created on 2022-02-25

locker 66.4
fastener 53.4
restraint 40.2
refrigerator 34.6
device 34
business 31
man 27.5
white goods 26.2
office 24.3
people 23.4
professional 21.9
corporate 21.5
male 21.3
businessman 20.3
home appliance 19.8
person 19.5
suit 18.8
adult 18.5
attractive 18.2
standing 17.4
black 16.3
fashion 15.8
work 15.7
clothing 15.1
executive 15
door 14.4
building 14
gate 13.9
men 13.7
worker 13.6
job 13.3
happy 13.2
appliance 13.1
success 12.9
businesswoman 12.7
turnstile 12.7
women 12.6
pretty 12.6
interior 12.4
indoors 12.3
lifestyle 12.3
clothes 12.2
modern 11.9
successful 11.9
elevator 11.7
group 11.3
20s 11
team 10.7
handsome 10.7
smile 10.7
urban 10.5
manager 10.2
two 10.2
architecture 10.2
city 10
holding 9.9
working 9.7
style 9.6
room 9.6
businesspeople 9.5
lifting device 9.4
briefcase 9.3
shopping 9.3
teamwork 9.3
sale 9.2
indoor 9.1
garment 8.8
mall 8.8
sales 8.6
movable barrier 8.5
shop 8.4
company 8.4
phone 8.3
occupation 8.2
stylish 8.1
dress 8.1
call 7.9
couple 7.8
businessmen 7.8
portrait 7.8
entrance 7.7
boss 7.6
tie 7.6
career 7.6
lady 7.3
looking 7.2
glass 7

Google
created on 2022-02-25

Clothing 98.8
Sleeve 87.2
One-piece garment 78.4
Formal wear 73.6
Pattern 69.8
Vintage clothing 69.2
Apron 67.7
Classic 67.2
Art 65.9
Uniform 65.8
Event 63.9
Street fashion 60.7
Fashion design 60.6
Room 60.3
Day dress 59.2
Smile 57.1
Font 56.3
Costume 55.2
Pattern 53.3
Retro style 52.9

Microsoft
created on 2022-02-25

text 99.7
person 96.3
clothing 92.7
smile 90.2
standing 81.8
posing 72.6
coat 65.5
human face 59.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-42
Gender Female, 72.5%
Happy 99.9%
Surprised 0.1%
Angry 0%
Confused 0%
Calm 0%
Fear 0%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 48-54
Gender Female, 88%
Happy 97.3%
Disgusted 1.1%
Surprised 0.5%
Confused 0.4%
Angry 0.4%
Fear 0.3%
Sad 0.1%
Calm 0%

AWS Rekognition

Age 56-64
Gender Male, 100%
Happy 47.5%
Calm 41%
Surprised 3.7%
Disgusted 2.9%
Confused 1.9%
Angry 1.6%
Fear 0.8%
Sad 0.4%

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 53
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Suit 85.9%

Captions

Microsoft

a man and woman posing for a photo 73.5%
a person holding a sign posing for the camera 73.4%
a man and a woman posing for a photo 73.3%

Text analysis

Amazon

65
186
JAN
132

Google

132
186 132
186