Human Generated Data

Title

Untitled (two men standing with cow)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2868

Human Generated Data

Title

Untitled (two men standing with cow)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-16

Cow 99.9
Cattle 99.9
Mammal 99.9
Animal 99.9
Person 99.8
Human 99.8
Person 98.5
Person 97.7
Bull 95
Person 94.7
Person 92.3
Person 88.2
Person 85.9
Person 84.2
Dairy Cow 66.3
Person 64.7
Person 63.1
Ox 58.4
Car 56.2
Transportation 56.2
Vehicle 56.2
Automobile 56.2
Person 55.5
Person 49
Person 42.8

Imagga
created on 2022-01-16

horse 46
farm 36.6
rural 30
cattle 28.6
animal 26.2
horses 25.3
animals 24.1
ranch 23.5
field 20.9
livestock 20.5
dairy 20.4
pasture 20.1
equine 20
grass 19.8
brown 19.1
stallion 17.6
mare 16.7
ox 16.6
bovine 16.1
cow 16.1
country 15.8
mammal 15.7
countryside 15.5
head 15.1
sunset 14.4
bull 13.5
meadow 13.5
herd 12.8
outdoors 12.7
farming 12.3
outdoor 12.2
equestrian 11.8
mane 11.7
riding 11.7
cowboy 11.6
summer 11.6
saddle 10.9
fence 10.8
sun 10.5
wild 10.5
landscape 10.4
sky 10.2
domestic 9.9
agriculture 9.7
people 9.5
outside 9.4
desert 9.3
two 9.3
dog 9.2
camel 9.2
travel 9.2
barn 9
pony 8.9
pen 8.6
face 8.5
portrait 8.4
bridle 8.3
sport 8.2
resort 8.2
wildlife 8
cute 7.9
horseback 7.9
stable 7.9
rider 7.9
mammals 7.8
ride 7.8
sunny 7.7
sunrise 7.5
pet 7.3
black 7.2
sand 7.1
eye 7.1

Google
created on 2022-01-16

Microsoft
created on 2022-01-16

text 98.8
outdoor 97.8
horse 94.9
standing 84.7
animal 83.6
mammal 81.8
person 53.1

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 99.4%
Calm 99.9%
Surprised 0%
Happy 0%
Disgusted 0%
Confused 0%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 36-44
Gender Male, 51.9%
Calm 31.9%
Confused 25.8%
Sad 15.9%
Angry 10.8%
Disgusted 6.2%
Surprised 4%
Fear 2.9%
Happy 2.7%

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Calm 71.2%
Confused 16%
Sad 3.6%
Angry 3.1%
Disgusted 2.4%
Surprised 2%
Fear 1.1%
Happy 0.6%

AWS Rekognition

Age 22-30
Gender Female, 55.6%
Calm 48.9%
Fear 10.1%
Surprised 9.5%
Disgusted 7.9%
Sad 7.4%
Happy 6.7%
Confused 5.9%
Angry 3.6%

AWS Rekognition

Age 51-59
Gender Male, 98.5%
Calm 46.3%
Disgusted 42.7%
Happy 5.7%
Surprised 2.1%
Confused 1.4%
Angry 0.9%
Fear 0.6%
Sad 0.3%

AWS Rekognition

Age 19-27
Gender Male, 95.1%
Calm 96%
Sad 2.3%
Fear 0.8%
Surprised 0.3%
Disgusted 0.2%
Confused 0.2%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 18-24
Gender Female, 86.5%
Calm 97.5%
Sad 1.3%
Angry 0.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%
Happy 0%
Confused 0%

AWS Rekognition

Age 38-46
Gender Female, 94.1%
Happy 47%
Calm 20.6%
Disgusted 15.3%
Fear 6.1%
Surprised 4.4%
Sad 2.5%
Confused 2.5%
Angry 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Cow 99.9%
Person 99.8%
Car 56.2%

Captions

Microsoft

a group of people standing next to a cow 94.6%
a person standing next to a cow 93.6%
a group of people standing in front of a cow 92.6%

Text analysis

Amazon

KODAK-
MAXWELI
KODAK- SALETA
SALETA

Google

MAXWELL
NAGON
MAXWELL NAGON