Human Generated Data

Title

John Baldessari

Date

1993

People

Artist: Nancy Lee Katz, American 1947 - 2018

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Michael S. Sachs, 2021.429

Copyright

© Michael S. Sachs

Human Generated Data

Title

John Baldessari

People

Artist: Nancy Lee Katz, American 1947 - 2018

Date

1993

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Michael S. Sachs, 2021.429

Copyright

© Michael S. Sachs

Machine Generated Data

Tags

Amazon
created on 2022-12-07

Portrait 99.6
Head 99.6
Face 99.6
Photography 99.6
Person 98.8
Man 98.8
Adult 98.8
Male 98.8
Person 98.6
Adult 98.6
Bride 98.6
Woman 98.6
Female 98.6
Wedding 98.6
Person 98.2
Woman 97.2
Person 97.2
Adult 97.2
Bride 97.2
Female 97.2
Person 94.8
Man 94.8
Adult 94.8
Male 94.8
Text 91.2
Tie 90.4
Formal Wear 90.4
Accessories 90.4
Tie 74.4
Cup 69
Number 66.9
Symbol 66.9
Indoors 64
Beard 63.8
Tie 63.4
People 56.8
Table 55.8
Furniture 55.8
Collage 55.4
Art 55.4
Restaurant 55.3

Clarifai
created on 2023-10-12

people 99.3
monochrome 98.4
adult 96.4
woman 96.2
man 94.4
portrait 94.2
child 93.2
family 88.4
elderly 88.1
indoors 87.6
two 87.2
nostalgia 85.9
one 83.5
street 82.4
group 82.4
wear 78.3
sit 76.5
retro 75
wait 73.6
education 72.1

Imagga
created on 2022-12-07

senior 42.2
man 31.6
male 30.5
elderly 29.7
person 27.5
people 27.3
old 27.2
portrait 26.5
adult 25.8
mature 25.1
retirement 23.1
retired 22.3
happy 21.3
laptop 20.1
home 19.9
smiling 19.5
looking 19.2
billboard 18.4
computer 17.1
business 17
clock 15.6
grandfather 15.2
face 14.9
signboard 14.9
glasses 14.8
office 14.5
expression 14.5
aged 14.5
gray 14.4
smile 14.3
couple 13.9
call 13.8
eyes 13.8
sitting 13.7
older 13.6
work 13.3
businessman 13.2
pensioner 13
grandma 12.9
one 12.7
hair 12.7
wife 12.3
indoors 12.3
technology 11.9
elder 11.8
hand 11.6
lifestyle 11.6
husband 11.5
serious 11.4
citizen 10.8
grandmother 10.8
holding 10.7
structure 10.7
working 10.6
lady 10.6
wall clock 10.5
together 10.5
look 10.5
age 10.5
casual 10.2
timepiece 9.9
money 9.4
close 9.1
bill 8.6
finance 8.4
health 8.3
notebook 8.1
currency 8.1
handsome 8
wrinkle 7.9
happiness 7.8
surfing 7.8
60s 7.8
corporate 7.7
sad 7.7
aging 7.7
head 7.6
human 7.5
manager 7.4
life 7.3
alone 7.3
room 7.2
love 7.1
job 7.1

Google
created on 2022-12-07

Microsoft
created on 2022-12-07

text 99.8
drawing 97
cartoon 93.2
sketch 89.9
handwriting 78.5
black and white 76.5
white 71.9
human face 68.7
person 67.7
poster 59.2
old 53.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 63-73
Gender Male, 99.9%
Calm 86.8%
Surprised 8.6%
Fear 8.6%
Sad 2.7%
Confused 0.8%
Angry 0.3%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 28-38
Gender Female, 89.9%
Sad 99.3%
Calm 27.4%
Angry 7%
Surprised 6.8%
Fear 6.6%
Confused 0.5%
Disgusted 0.5%
Happy 0.4%

AWS Rekognition

Age 29-39
Gender Male, 99.5%
Confused 40.6%
Calm 35.7%
Disgusted 9.6%
Surprised 8%
Fear 7%
Sad 4.7%
Angry 1.7%
Happy 0.9%

AWS Rekognition

Age 23-33
Gender Female, 99.7%
Sad 97%
Calm 10.2%
Confused 10.1%
Happy 9%
Surprised 8.9%
Angry 7.3%
Fear 6.7%
Disgusted 5.8%

AWS Rekognition

Age 19-27
Gender Male, 92.1%
Fear 88.7%
Angry 8.9%
Surprised 6.6%
Disgusted 5.5%
Sad 5%
Confused 3.5%
Calm 1.8%
Happy 1.5%

Microsoft Cognitive Services

Age 67
Gender Male

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Man 98.8%
Adult 98.8%
Male 98.8%
Bride 98.6%
Woman 98.6%
Female 98.6%
Tie 90.4%
Cup 69%

Captions

Text analysis

Amazon

226
6'6"
lbs

Google

७१॥ 226 ..१.१
७१
226
..१.१