Human Generated Data

Title

Max Liebermann (1847-1935)
Date

c. 1920
People

Artist: Lotte Jacobi, German 1896 - 1990
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sam Pratt, P2003.225

Human Generated Data

Title

Max Liebermann (1847-1935)

People

Artist: Lotte Jacobi, German 1896 - 1990

Date

c. 1920

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sam Pratt, P2003.225

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Person 95.2
Human 95.2
Art 84.7
Clothing 84.2
Apparel 84.2
Shoe 73.9
Footwear 73.9
Shoe 72.6
Coat 71.8
Overcoat 69.7
Standing 68.5
Portrait 63
Face 63
Photography 63
Photo 63
Painting 61.3
Bench 60.7
Furniture 60.7
Person 48.4
Person 45.9

Clarifai
created on 2023-10-30

people 99.9
one 99.2
leader 98.5
adult 98.5
man 97.7
administration 97
portrait 96.9
two 94.4
elderly 93.4
wear 93.3
scientist 92.2
facial hair 90.9
chair 89.6
group 87.6
outfit 86.9
furniture 84.9
home 83.8
painting 83.3
art 82.2
outerwear 81.7

Imagga
created on 2022-05-28

suit 48
man 37.6
male 36.2
businessman 31.8
business 30.4
person 30.4
corporate 28.4
people 25.7
adult 25.2
office 24.8
executive 24.6
professional 23.2
portrait 20.7
work 20.4
garment 20.2
building 20.1
happy 20.1
standing 20
men 19.8
handsome 18.7
clothing 18.3
looking 16.8
success 16.1
job 15.9
worker 15.6
black 15.2
confident 14.6
jacket 13.6
human 12.7
casual 12.7
outdoors 12.7
attractive 12.6
tie 12.3
smile 12.1
manager 12.1
speaker 12
old 11.8
day 11.8
career 11.4
alone 11
smiling 10.9
face 10.7
couple 10.5
one 10.5
architecture 10.3
mature 10.2
city 10
holding 9.9
fashion 9.8
pretty 9.8
covering 9.8
businesspeople 9.5
meeting 9.4
outside 9.4
happiness 9.4
lifestyle 9.4
expression 9.4
shirt 9.3
bow tie 9.2
house 9.2
hand 9.1
modern 9.1
student 9.1
articulator 9
consumer goods 9
urban 8.7
hair 8.7
boy 8.7
formal 8.6
workplace 8.6
successful 8.2
businesswoman 8.2
teacher 8.2
dress 8.1
necktie 7.9
model 7.8
guy 7.7
outdoor 7.6
finance 7.6
room 7.5
world 7.5
device 7.4
phone 7.4
cheerful 7.3
window 7.2
stylish 7.2
home 7.2
life 7.2
team 7.2
working 7.1
indoors 7
look 7

Google
created on 2022-05-28

Suit trousers 93.6
Picture frame 91.8
Collar 81.4
Suit 79.6
Art 79.2
Blazer 77.8
Snapshot 74.3
Monochrome 73.5
Monochrome photography 71.7
Vintage clothing 71.3
Painting 71
Room 67.5
Visual arts 64.6
Stock photography 64.6
Formal wear 62.1
Tie 54
Still life photography 53.7
Portrait 53
History 52.4

Microsoft
created on 2022-05-28

man 97.4
wall 95.7
indoor 95.2
person 95.2
clothing 94.4
text 93.2
standing 92.3
suit 91.2
drawing 88.5
painting 86.6
picture frame 78
old 75.3
sketch 74.8
black and white 69.2
posing 61.1
photograph 50.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 72-82
Gender Male, 100%
Calm 87.8%
Surprised 7.1%
Fear 6.1%
Confused 5.3%
Sad 2.8%
Angry 1.8%
Happy 0.6%
Disgusted 0.5%

Microsoft Cognitive Services

Age 64
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Bench
Person 95.2%
Person 48.4%
Person 45.9%
Shoe 73.9%
Shoe 72.6%
Bench 60.7%

Categories

Imagga

streetview architecture 99.9%

Captions

Microsoft
created on 2022-05-28

a person standing posing for the camera 94.2%
a man standing in a room 94.1%
an old photo of a man 91.7%