Human Generated Data

Title

Benefit, The Museum of Modern Art, New York City

Date

June 1977

People

Artist: Larry Fink, American born 1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of George and Alexandra Stephanopoulos, 2014.472

Copyright

© Larry Fink

Human Generated Data

Title

Benefit, The Museum of Modern Art, New York City

People

Artist: Larry Fink, American born 1941

Date

June 1977

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Apparel 99.4
Clothing 99.4
Overcoat 99.4
Coat 99.4
Human 98.3
Person 98.3
Person 97.1
Tuxedo 94.3
Person 90.4
Chair 89.3
Furniture 89.3
Suit 89.1
Officer 79.9
Military 79.9
Military Uniform 79.9
Sitting 78.9
Evening Dress 76.7
Robe 76.7
Gown 76.7
Fashion 76.7
Flower 59.9
Blossom 59.9
Plant 59.9
Finger 57.8
Female 57.6
Suit 56
People 55.5

Clarifai
created on 2018-02-09

people 99.8
group 99.4
woman 98.1
adult 97.7
man 96.2
dinner jacket 95.5
two 94.2
three 93.7
wear 93.2
four 92.7
leader 92.6
actress 92.1
outfit 91.1
administration 91.1
group together 90.2
five 90.2
actor 89.8
dress 89.6
wedding 88.5
several 88.4

Imagga
created on 2018-02-09

man 38.3
male 32.7
people 30.7
person 28.1
adult 25
couple 23.5
business 23.1
businessman 21.2
suit 19.2
room 18.2
dress 18.1
portrait 17.5
professional 17.2
office 16.9
uniform 16.7
happy 16.3
clothing 16
love 15.8
attractive 15.4
lifestyle 15.2
black 14.8
groom 14.7
fashion 14.3
singer 13.8
two 13.6
handsome 13.4
happiness 13.3
interior 13.3
indoors 12.3
musician 12.3
executive 11.9
romantic 11.6
together 11.4
tie 11.4
corporate 11.2
men 11.2
indoor 11
family 10.7
bride 10.6
modern 10.5
standing 10.4
performer 10.2
wedding 10.1
life 10.1
night 9.8
style 9.6
smiling 9.4
relationship 9.4
youth 9.4
shirt 9.3
hand 9.1
pretty 9.1
romance 8.9
lady 8.9
group 8.9
home 8.8
boy 8.7
married 8.6
businesspeople 8.5
expression 8.5
leisure 8.3
speaker 8.3
vintage 8.3
harmonica 8.2
job 8
women 7.9
work 7.8
smile 7.8
child 7.8
outfit 7.8
emotional 7.8
teacher 7.7
elegant 7.7
wall 7.7
husband 7.6
casual 7.6
chair 7.6
call 7.6
elegance 7.6
communication 7.6
togetherness 7.6
bouquet 7.5
meeting 7.5
human 7.5
fun 7.5
outdoors 7.5
covering 7.5
manager 7.4
holding 7.4
glasses 7.4
phone 7.4
retro 7.4
businesswoman 7.3
sexy 7.2
entrepreneur 7.2
posing 7.1
face 7.1
to 7.1

Google
created on 2018-02-09

fashion 75.5
dress 75.1
ceremony 71.3
vintage clothing 70.7
event 64.7
human behavior 62.6
fun 61.9
formal wear 60.3
girl 59.2
family 54.6
gentleman 51.1

Microsoft
created on 2018-02-09

person 99.9
indoor 87.3
people 56.5
posing 44.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-59
Gender Male, 98.8%
Surprised 9.2%
Angry 3.9%
Sad 4.2%
Calm 64.4%
Disgusted 2.1%
Confused 9.9%
Happy 6.3%

AWS Rekognition

Age 48-68
Gender Female, 94.7%
Confused 3.1%
Sad 8.6%
Disgusted 0.7%
Happy 0.3%
Angry 4.8%
Surprised 1.4%
Calm 81%

AWS Rekognition

Age 26-43
Gender Male, 97.3%
Angry 3.7%
Disgusted 1.2%
Calm 74.3%
Happy 3.9%
Sad 9.9%
Surprised 3.6%
Confused 3.4%

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 52
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Suit 89.1%

Captions

Microsoft

a group of people posing for the camera 96.5%
a group of people posing for a photo 95.1%
a group of people posing for a picture 95%

Text analysis

Amazon

Phot
Willian:
Willian: lom
lom

Google

Pho
Willia
Pho Willia 0
0