Human Generated Data

Title

Untitled (people eating at banquet table)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17781

Human Generated Data

Title

Untitled (people eating at banquet table)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17781

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.4
Human 99.4
Person 99.3
Person 98.4
Person 98.4
Person 96.7
Person 96.2
Face 95.5
Furniture 95.1
Plant 93
Smile 89.7
Female 88.5
Flower 86.8
Blossom 86.8
Clothing 83.6
Apparel 83.6
Flower Arrangement 80.2
Vase 79.8
Jar 79.8
Pottery 79.8
Chair 78.7
Suit 76.4
Overcoat 76.4
Coat 76.4
Table 76.2
Flower Bouquet 74.8
Indoors 74.1
Chair 73.7
Person 72.4
Girl 72.2
Potted Plant 70.9
Living Room 68.7
Room 68.7
Portrait 68.1
Photography 68.1
Photo 68.1
Woman 67
Mammal 66
Animal 66
Ikebana 64
Ornament 64
Art 64
Man 63.8
Pet 62.8
Canine 60
Kid 57.6
Child 57.6

Clarifai
created on 2023-10-29

people 99.9
group together 98.1
group 98.1
man 97.6
adult 96.6
woman 95.8
many 95
several 94.5
monochrome 92.5
vehicle 92
furniture 90.7
two 90.1
three 89.1
administration 89
recreation 88.1
four 87.7
five 87.7
indoors 87.4
military 86.3
leader 85.1

Imagga
created on 2022-02-26

man 32.2
building 29.1
people 22.8
work 22.8
business 22.4
person 21.4
male 20.5
adult 17
businessman 15.9
day 15.7
stall 15.5
seller 15.2
sitting 13.7
outdoors 13.4
architecture 13.4
structure 12.8
working 12.4
greenhouse 12.2
senior 12.2
office 11.9
technology 11.9
old 11.8
smiling 11.6
home 11.2
men 11.2
sky 10.8
elderly 10.5
together 10.5
professional 10.5
portrait 10.3
worker 10.3
construction 10.3
modern 9.8
job 9.7
computer 9.6
couple 9.6
color 9.4
happiness 9.4
happy 9.4
mature 9.3
engineer 9.2
laptop 9.1
looking 8.8
park 8.5
businesspeople 8.5
casual 8.5
company 8.4
house 8.3
city 8.3
vacation 8.2
businesswoman 8.2
handsome 8
lifestyle 7.9
indoors 7.9
40s 7.8
architect 7.7
outside 7.7
engineering 7.6
20s 7.3
new 7.3
bright 7.1
builder 7

Google
created on 2022-02-26

Black 89.9
Black-and-white 86.2
Style 83.9
Hat 76
Monochrome photography 75.3
Monochrome 75.1
Event 72.1
Art 68.2
Vintage clothing 66.9
History 64.5
Chair 63.7
Room 63.6
Suit 63.5
Stock photography 62.4
Fun 60.6
Still life photography 58.8
Glass 58.2
Visual arts 58.1
Sitting 57.2
Curtain 56.7

Microsoft
created on 2022-02-26

person 94.2
clothing 91.2
text 84.3
man 80.4
black and white 76.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Female, 82.6%
Happy 78.8%
Sad 8.5%
Calm 7.1%
Surprised 1.8%
Fear 1.6%
Confused 1%
Angry 0.7%
Disgusted 0.6%

AWS Rekognition

Age 16-24
Gender Male, 99.1%
Sad 71.3%
Angry 8.9%
Calm 7.2%
Disgusted 4.2%
Happy 4.1%
Surprised 1.9%
Confused 1.4%
Fear 0.9%

AWS Rekognition

Age 45-51
Gender Female, 96.4%
Calm 64.4%
Happy 34.2%
Confused 0.5%
Sad 0.3%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 31-41
Gender Female, 99%
Calm 68.6%
Happy 25.8%
Sad 2.1%
Disgusted 0.9%
Confused 0.8%
Fear 0.8%
Angry 0.5%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person
Chair
Person 99.4%
Person 99.3%
Person 98.4%
Person 98.4%
Person 96.7%
Person 96.2%
Person 72.4%
Chair 78.7%
Chair 73.7%

Categories

Imagga

streetview architecture 88.8%
paintings art 10.2%

Text analysis

Amazon

2
7
!

Google

MJI7--Y T 3RA°2- - XAGOX
MJI7--Y
T
3RA°2-
-
XAGOX