Human Generated Data

Title

Untitled (golf tournament, announcer under umbrella)
Date

c. 1950
People

Artist: Robert Burian, American active 1940s-1950s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19405

Human Generated Data

Title

Untitled (golf tournament, announcer under umbrella)

People

Artist: Robert Burian, American active 1940s-1950s

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19405

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.5
Human 99.5
Person 99.2
Person 97.9
Person 96.2
Person 93.4
Person 93.1
Person 91.6
Clothing 91.3
Apparel 91.3
Person 91.1
Person 86.7
Person 85.3
Person 84.7
Furniture 82.6
Person 77.5
Canopy 75.6
Chair 74.3
Person 69.3
People 67.4
Outdoors 67.1
Person 66.4
Person 65.8
Crowd 64.9
Photography 61.3
Photo 61.3
Umbrella 59.1
Nature 58.8
Wedding 57.9
Portrait 57.2
Face 57.2
Person 51.8
Person 49.5
Person 46
Person 44.9
Person 43.4

Clarifai
created on 2023-10-22

people 99.5
umbrella 99.3
group together 97.8
adult 96.8
chair 96.4
man 96.2
sunshade 96.1
group 94.8
monochrome 93.8
many 93.8
woman 90.7
leader 89.8
recreation 88.3
child 87.7
furniture 86.3
wear 84.6
seat 84
tent 82.5
vintage 81.8
two 80.8

Imagga
created on 2022-03-05

parasol 49.3
patio 27.3
structure 23
beach 21.2
sea 20.3
area 20.1
chair 20
sand 18.1
sky 17.8
sun 17.7
holiday 17.2
travel 16.9
water 16.7
vacation 16.4
tropical 16.2
summer 15.4
umbrella 15.2
ocean 14.9
landscape 14.9
resort 14.3
relax 14.3
island 13.7
paradise 13.2
building 12.4
tree 12.3
outdoor 12.2
house 11.7
leisure 11.6
people 11.2
color 11.1
tourism 10.7
outdoors 10.4
palm 10.3
architecture 10.1
city 10
tourist 9.8
scenic 9.7
clouds 9.3
relaxation 9.2
old 9.1
coast 9
scene 8.7
snow 8.1
romantic 8
sunny 7.7
bay 7.7
park 7.6
vacations 7.5
coastline 7.5
peaceful 7.3
exotic 7.3
black 7.2
home 7.2

Google
created on 2022-03-05

Furniture 94.8
Vertebrate 92.1
Human 89.2
Chair 89.2
Plant 87.8
Organism 86.7
Mammal 85.5
Tree 85.5
Style 84
Art 83.4
Black-and-white 82.9
Adaptation 79.4
Font 78.7
Table 77.4
Tints and shades 76.9
Monochrome 75.4
Monochrome photography 75.4
Vintage clothing 73.4
Illustration 72.3
Umbrella 72.1

Microsoft
created on 2022-03-05

text 99.7
wedding 98.3
ceremony 92.9
person 86.9
wedding dress 83.9
clothing 80.4
bride 74.8
tree 64.4
man 61
marriage 50.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Female, 89.2%
Calm 63.9%
Happy 13.9%
Sad 10.4%
Angry 3.8%
Disgusted 2.8%
Confused 2.8%
Surprised 1.4%
Fear 0.9%

AWS Rekognition

Age 21-29
Gender Male, 97.2%
Calm 89%
Happy 4.3%
Sad 4.2%
Confused 0.8%
Fear 0.5%
Angry 0.5%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 25-35
Gender Male, 98.8%
Calm 67.7%
Angry 24.4%
Happy 2.2%
Fear 1.7%
Sad 1.4%
Surprised 1.2%
Confused 1%
Disgusted 0.4%

AWS Rekognition

Age 42-50
Gender Male, 97.9%
Happy 64.6%
Calm 15.5%
Sad 9.6%
Confused 3.5%
Disgusted 2.2%
Surprised 1.8%
Angry 1.7%
Fear 1%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Calm 36.5%
Happy 25.1%
Fear 19.2%
Sad 6.7%
Angry 5.6%
Disgusted 3.7%
Surprised 2.1%
Confused 1.1%

AWS Rekognition

Age 22-30
Gender Female, 96.7%
Calm 92.3%
Happy 2.5%
Sad 2.2%
Angry 1.1%
Confused 0.7%
Disgusted 0.5%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 23-31
Gender Male, 98.5%
Calm 68.3%
Happy 11.4%
Sad 10.1%
Angry 6.1%
Disgusted 1.4%
Surprised 1.3%
Fear 0.8%
Confused 0.6%

AWS Rekognition

Age 30-40
Gender Female, 62.7%
Happy 94.4%
Angry 2.8%
Surprised 1.1%
Sad 0.6%
Calm 0.4%
Fear 0.2%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 46.6%
Angry 32.3%
Sad 7.8%
Happy 7.2%
Fear 2.3%
Surprised 1.9%
Disgusted 1.1%
Confused 0.8%

AWS Rekognition

Age 23-33
Gender Male, 93.9%
Happy 70.1%
Sad 11.1%
Calm 10.8%
Fear 3%
Angry 2.8%
Surprised 1%
Disgusted 0.7%
Confused 0.4%

AWS Rekognition

Age 24-34
Gender Male, 95.4%
Calm 99.2%
Sad 0.3%
Happy 0.2%
Confused 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 50.9%
Sad 27.9%
Angry 6.5%
Confused 5.4%
Happy 4.3%
Surprised 2.1%
Disgusted 1.6%
Fear 1.3%

AWS Rekognition

Age 22-30
Gender Female, 66.4%
Happy 81.7%
Calm 6.7%
Sad 5.6%
Fear 2.2%
Angry 1.7%
Surprised 1%
Confused 0.6%
Disgusted 0.6%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Calm 34.8%
Sad 27.3%
Happy 17.5%
Angry 9.5%
Disgusted 4.5%
Fear 3.1%
Confused 2.2%
Surprised 1.1%

AWS Rekognition

Age 14-22
Gender Male, 75%
Calm 76%
Sad 18.3%
Happy 2.7%
Confused 1%
Angry 0.7%
Disgusted 0.5%
Surprised 0.5%
Fear 0.4%

AWS Rekognition

Age 22-30
Gender Male, 68.8%
Happy 73.7%
Calm 14.6%
Sad 6%
Fear 1.8%
Angry 1.6%
Surprised 1%
Disgusted 1%
Confused 0.3%

AWS Rekognition

Age 31-41
Gender Male, 99.1%
Calm 89.5%
Happy 3.4%
Sad 2.6%
Angry 2.3%
Disgusted 0.7%
Fear 0.6%
Surprised 0.5%
Confused 0.3%

AWS Rekognition

Age 20-28
Gender Male, 60.1%
Angry 39%
Calm 36.8%
Happy 11.1%
Sad 7.3%
Surprised 2.8%
Confused 1.5%
Fear 0.8%
Disgusted 0.6%

AWS Rekognition

Age 22-30
Gender Male, 90.3%
Happy 53.5%
Calm 19.2%
Sad 17.6%
Angry 3.2%
Confused 2.1%
Disgusted 2.1%
Surprised 1.6%
Fear 0.7%

AWS Rekognition

Age 23-31
Gender Female, 65.3%
Calm 77.3%
Sad 7.2%
Happy 6.3%
Confused 2.5%
Disgusted 2.3%
Fear 1.6%
Angry 1.5%
Surprised 1.3%

AWS Rekognition

Age 24-34
Gender Male, 97.9%
Calm 68.4%
Happy 13.9%
Sad 4.5%
Disgusted 3.7%
Surprised 3.2%
Angry 2.6%
Confused 2.5%
Fear 1.1%

AWS Rekognition

Age 22-30
Gender Male, 73.1%
Calm 71.1%
Sad 22.2%
Confused 2.6%
Disgusted 1.3%
Surprised 1%
Happy 0.7%
Angry 0.5%
Fear 0.5%

AWS Rekognition

Age 26-36
Gender Male, 59.9%
Calm 83.3%
Sad 6.4%
Happy 2.9%
Confused 2.2%
Angry 2.1%
Fear 1.7%
Disgusted 0.8%
Surprised 0.6%

AWS Rekognition

Age 37-45
Gender Male, 99.5%
Calm 47%
Happy 23.8%
Sad 12.4%
Confused 11.1%
Angry 3.2%
Surprised 1%
Disgusted 1%
Fear 0.4%

AWS Rekognition

Age 22-30
Gender Male, 62.2%
Calm 59.4%
Happy 20%
Surprised 8.8%
Disgusted 4.2%
Fear 4.1%
Angry 2.1%
Sad 0.8%
Confused 0.6%

AWS Rekognition

Age 21-29
Gender Female, 62.1%
Calm 44.7%
Happy 27.1%
Sad 6.8%
Angry 6.1%
Disgusted 5.8%
Fear 3.9%
Surprised 3.7%
Confused 2.1%

AWS Rekognition

Age 22-30
Gender Male, 51.8%
Sad 38.4%
Calm 26.9%
Angry 11.2%
Happy 11%
Confused 6.9%
Fear 3%
Disgusted 1.4%
Surprised 1.1%

AWS Rekognition

Age 25-35
Gender Male, 98.3%
Calm 87.8%
Angry 3.3%
Sad 3%
Fear 2.4%
Disgusted 1.5%
Happy 1%
Surprised 0.6%
Confused 0.3%

AWS Rekognition

Age 21-29
Gender Male, 57.5%
Calm 86.6%
Sad 8.7%
Fear 2.1%
Angry 0.8%
Happy 0.7%
Disgusted 0.6%
Confused 0.4%
Surprised 0.2%

AWS Rekognition

Age 23-31
Gender Male, 54.5%
Happy 92.6%
Calm 2.8%
Sad 1.8%
Angry 1.4%
Fear 0.5%
Surprised 0.4%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 16-22
Gender Male, 80.3%
Calm 46.7%
Sad 38.5%
Angry 7.3%
Fear 3%
Confused 1.9%
Happy 1.3%
Surprised 0.7%
Disgusted 0.6%

AWS Rekognition

Age 22-30
Gender Female, 53.3%
Calm 60.5%
Sad 10.1%
Fear 7.8%
Happy 6.2%
Surprised 5.5%
Confused 5%
Angry 3%
Disgusted 1.9%

AWS Rekognition

Age 28-38
Gender Male, 99.2%
Sad 36.9%
Happy 27.2%
Calm 25.9%
Confused 3.7%
Angry 2.3%
Surprised 1.6%
Disgusted 1.2%
Fear 1.1%

AWS Rekognition

Age 20-28
Gender Male, 95.7%
Happy 89.2%
Calm 8%
Sad 1.2%
Fear 0.5%
Angry 0.4%
Surprised 0.3%
Disgusted 0.3%
Confused 0.1%

AWS Rekognition

Age 23-33
Gender Male, 84.1%
Calm 97.9%
Sad 0.9%
Happy 0.4%
Fear 0.3%
Surprised 0.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 21-29
Gender Male, 75.2%
Calm 57.7%
Fear 38.6%
Sad 1.1%
Surprised 0.9%
Happy 0.8%
Angry 0.4%
Confused 0.3%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Chair
Person 99.5%
Person 99.2%
Person 97.9%
Person 96.2%
Person 93.4%
Person 93.1%
Person 91.6%
Person 91.1%
Person 86.7%
Person 85.3%
Person 84.7%
Person 77.5%
Person 69.3%
Person 66.4%
Person 65.8%
Person 51.8%
Person 49.5%
Person 46%
Person 44.9%
Person 43.4%
Chair 74.3%

Categories

Imagga

streetview architecture 44.3%
text visuals 29.1%
paintings art 13.2%
interior objects 11.2%

Captions

Microsoft
created on 2022-03-05

a group of people posing for a photo 39.3%
a group of people in a field 39.2%
a group of people on a field 39.1%

Text analysis

Amazon

FILM
SAFETY
KODAK SAFETY FILM
KODAK

Google

.... ..I. K.ODAK SA FETY FILM KODAK SAFETY EILM
....
..I.
K.ODAK
SA
FETY
FILM
KODAK
SAFETY
EILM