Human Generated Data

Title

Yevgeny Khaldei

Date

1997

People

Artist: Nancy Lee Katz, American 1947 - 2018

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Michael S. Sachs, 2021.443

Copyright

© Michael S. Sachs

Human Generated Data

Title

Yevgeny Khaldei

People

Artist: Nancy Lee Katz, American 1947 - 2018

Date

1997

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Michael S. Sachs, 2021.443

Copyright

© Michael S. Sachs

Machine Generated Data

Tags

Amazon
created on 2022-12-12

Furniture 100
Person 99.2
Man 99.2
Adult 99.2
Male 99.2
Person 98.1
Baby 98.1
Finger 97.8
Hand 97.8
Body Part 97.8
Person 97.6
Man 97.6
Adult 97.6
Male 97.6
Person 96.9
Man 96.9
Adult 96.9
Male 96.9
Person 96.7
Living Room 95.2
Room 95.2
Indoors 95.2
Building 95.2
Architecture 95.2
Portrait 94.1
Face 94.1
Head 94.1
Photography 94.1
Person 93.4
Person 92.9
Person 91
Coat 87.8
Clothing 87.8
Person 78.2
Person 77.9
Glasses 76
Accessories 76
Person 74.7
Adult 74.7
Bride 74.7
Woman 74.7
Female 74.7
Wedding 74.7
Home Decor 66.4
Person 66.3
Person 60
Couch 58.6
Cushion 56.7
Sword 56.4
Weapon 56.4
Interior Design 56.4
Laptop 56.1
Pc 56.1
Electronics 56.1
Computer 56.1
Sitting 55.4

Clarifai
created on 2023-10-13

people 100
adult 99.4
two 98
group 97.8
one 97.7
administration 97.1
war 97
group together 96.5
man 95.9
wear 93.3
leader 92.4
three 92.1
military 91.3
portrait 90.5
woman 89.3
offense 88.9
vehicle 88.5
many 87.8
weapon 84.1
aircraft 82.4

Imagga
created on 2022-12-12

work 34.7
person 31.9
man 31.6
computer 29.2
laptop 29.1
newspaper 26.3
business 25.5
people 25.1
male 24.1
working 23
home 20.7
job 20.3
product 20.2
adult 20.2
sitting 18.9
worker 17.9
technology 17.8
office 17.8
happy 15
businessman 15
creation 15
looking 14.4
notebook 14.1
indoors 14.1
desk 13.2
smile 12.8
casual 12.7
one 12.7
keyboard 12.3
professional 12.1
occupation 11.9
interior 11.5
device 11.4
women 11.1
student 11
communication 10.9
lifestyle 10.8
scholar 10.8
black 10.8
hand 10.6
human 10.5
smiling 10.1
indoor 10
pretty 9.8
portrait 9.7
intellectual 9.6
wireless 9.5
men 9.4
mature 9.3
phone 9.2
steel 8.8
together 8.8
using 8.7
table 8.7
corporate 8.6
face 8.5
two 8.5
senior 8.4
attractive 8.4
old 8.4
house 8.4
room 8.3
holding 8.2
success 8
shop 8
hands 7.8
tool 7.8
education 7.8
call 7.7
construction 7.7
sofa 7.7
mask 7.4
safety 7.4
confident 7.3
equipment 7.2
iron 7.1
paper 7.1

Google
created on 2022-12-12

Microsoft
created on 2022-12-12

person 99.3
black and white 91.5
text 90.9
clothing 82.2
man 73.3
old 50.4
clothes 20.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 60-70
Gender Male, 100%
Calm 71.9%
Confused 10.2%
Surprised 7.8%
Sad 6.6%
Fear 6.3%
Angry 3.7%
Happy 1.1%
Disgusted 1%

AWS Rekognition

Age 23-33
Gender Female, 100%
Calm 63.2%
Fear 14.7%
Surprised 12.1%
Sad 4.2%
Angry 2.8%
Disgusted 2.2%
Happy 2.1%
Confused 1.5%

AWS Rekognition

Age 34-42
Gender Female, 72.4%
Happy 92.6%
Surprised 6.4%
Calm 6.1%
Fear 5.9%
Sad 2.2%
Angry 0.4%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 16-24
Gender Female, 62.2%
Fear 96.3%
Surprised 10.1%
Sad 2.3%
Calm 1.5%
Disgusted 0.9%
Angry 0.7%
Confused 0.4%
Happy 0.2%

AWS Rekognition

Age 35-43
Gender Male, 94.5%
Calm 98.3%
Surprised 6.3%
Fear 5.9%
Sad 2.7%
Confused 0.1%
Disgusted 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 16-24
Gender Male, 81.5%
Angry 76.2%
Calm 17.5%
Fear 8%
Surprised 6.4%
Sad 2.2%
Confused 0.4%
Happy 0.4%
Disgusted 0.2%

AWS Rekognition

Age 25-35
Gender Female, 55.3%
Fear 90.7%
Sad 15.4%
Surprised 6.7%
Angry 3.9%
Calm 3.8%
Confused 0.7%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 53-61
Gender Male, 99.7%
Calm 59.4%
Happy 12.1%
Disgusted 9.6%
Angry 8.1%
Surprised 7.4%
Fear 6.4%
Confused 5.6%
Sad 2.8%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 69.2%
Angry 23.4%
Surprised 6.6%
Fear 6%
Disgusted 4.4%
Sad 2.3%
Confused 1.4%
Happy 0.4%

AWS Rekognition

Age 39-47
Gender Male, 99.5%
Fear 65.5%
Angry 34.1%
Surprised 7.4%
Sad 5.8%
Calm 1.8%
Disgusted 1.8%
Happy 1.3%
Confused 0.8%

AWS Rekognition

Age 23-31
Gender Male, 99.8%
Disgusted 65%
Angry 20.7%
Surprised 7%
Fear 6.2%
Confused 5.4%
Calm 3.9%
Sad 2.9%
Happy 0.5%

AWS Rekognition

Age 18-26
Gender Female, 78.7%
Sad 57.9%
Calm 17%
Happy 14.2%
Confused 14.1%
Disgusted 14%
Surprised 9.9%
Fear 7.4%
Angry 2.2%

Microsoft Cognitive Services

Age 67
Gender Male

Microsoft Cognitive Services

Age 38
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Man 99.2%
Adult 99.2%
Male 99.2%
Baby 98.1%
Coat 87.8%
Glasses 76%
Bride 74.7%
Woman 74.7%
Female 74.7%
Couch 58.6%

Categories